2023-11-02 21:54:59,043 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-02 21:54:59,215 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed 2023-11-02 21:54:59,229 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-02 21:54:59,230 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/cluster_447f0e9b-ccb8-1ecb-10d1-87f66cbaf59a, deleteOnExit=true 2023-11-02 21:54:59,230 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-02 21:54:59,231 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/test.cache.data in system properties and HBase conf 2023-11-02 21:54:59,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/hadoop.tmp.dir in system properties and HBase conf 2023-11-02 21:54:59,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/hadoop.log.dir in system properties and HBase conf 2023-11-02 21:54:59,233 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-02 21:54:59,233 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-02 21:54:59,233 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-02 21:54:59,325 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-02 21:54:59,624 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-02 21:54:59,628 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-02 21:54:59,628 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-02 21:54:59,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-02 21:54:59,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-02 21:54:59,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-02 21:54:59,630 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-02 21:54:59,630 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-02 21:54:59,630 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-02 21:54:59,631 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-02 21:54:59,631 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/nfs.dump.dir in system properties and HBase conf 2023-11-02 21:54:59,631 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/java.io.tmpdir in system properties and HBase conf 2023-11-02 21:54:59,631 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-02 21:54:59,632 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-02 21:54:59,632 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-02 21:55:00,050 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-02 21:55:00,054 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-02 21:55:00,626 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-02 21:55:00,763 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-02 21:55:00,777 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-02 21:55:00,807 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-02 21:55:00,833 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/java.io.tmpdir/Jetty_localhost_46477_hdfs____.9doq9w/webapp 2023-11-02 21:55:00,944 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46477 2023-11-02 21:55:00,951 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-02 21:55:00,951 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-02 21:55:01,558 WARN [Listener at localhost/34899] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-02 21:55:01,610 WARN [Listener at localhost/34899] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-02 21:55:01,625 WARN [Listener at localhost/34899] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-02 21:55:01,632 INFO [Listener at localhost/34899] log.Slf4jLog(67): jetty-6.1.26 2023-11-02 21:55:01,636 INFO [Listener at localhost/34899] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/java.io.tmpdir/Jetty_localhost_35355_datanode____savw0o/webapp 2023-11-02 21:55:01,712 INFO [Listener at localhost/34899] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35355 2023-11-02 21:55:01,961 WARN [Listener at localhost/34483] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-02 21:55:02,991 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9310696dc60940cf: Processing first storage report for DS-dfb1c767-adfe-4b78-a1df-761663cef6b9 from datanode dd8357ca-4dc9-4c2d-b9a4-101cc4cce1ae 2023-11-02 21:55:02,992 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9310696dc60940cf: from storage DS-dfb1c767-adfe-4b78-a1df-761663cef6b9 node DatanodeRegistration(127.0.0.1:36373, datanodeUuid=dd8357ca-4dc9-4c2d-b9a4-101cc4cce1ae, infoPort=39795, infoSecurePort=0, ipcPort=34483, storageInfo=lv=-57;cid=testClusterID;nsid=256507505;c=1698962100113), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-02 21:55:02,992 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9310696dc60940cf: Processing first storage report for DS-9de80d7c-3ccf-4500-a30a-83e51be7b697 from datanode dd8357ca-4dc9-4c2d-b9a4-101cc4cce1ae 2023-11-02 21:55:02,992 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9310696dc60940cf: from storage DS-9de80d7c-3ccf-4500-a30a-83e51be7b697 node DatanodeRegistration(127.0.0.1:36373, datanodeUuid=dd8357ca-4dc9-4c2d-b9a4-101cc4cce1ae, infoPort=39795, infoSecurePort=0, ipcPort=34483, storageInfo=lv=-57;cid=testClusterID;nsid=256507505;c=1698962100113), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-02 21:55:02,993 DEBUG [Listener at localhost/34483] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed 2023-11-02 21:55:03,095 INFO [Listener at localhost/34483] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/cluster_447f0e9b-ccb8-1ecb-10d1-87f66cbaf59a/zookeeper_0, clientPort=49550, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/cluster_447f0e9b-ccb8-1ecb-10d1-87f66cbaf59a/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/cluster_447f0e9b-ccb8-1ecb-10d1-87f66cbaf59a/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-02 21:55:03,109 INFO [Listener at localhost/34483] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49550 2023-11-02 21:55:03,115 INFO [Listener at localhost/34483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-02 21:55:03,117 INFO [Listener at localhost/34483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-02 21:55:03,749 INFO [Listener at localhost/34483] util.FSUtils(471): Created version file at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16 with version=8 2023-11-02 21:55:03,750 INFO [Listener at localhost/34483] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/hbase-staging 2023-11-02 21:55:04,098 INFO [Listener at localhost/34483] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-02 21:55:04,495 INFO [Listener at localhost/34483] client.ConnectionUtils(127): master/jenkins-hbase12:0 server-side Connection retries=3 2023-11-02 21:55:04,521 INFO [Listener at localhost/34483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-02 21:55:04,521 INFO [Listener at localhost/34483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-02 21:55:04,521 INFO [Listener at localhost/34483] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-02 21:55:04,522 INFO [Listener at localhost/34483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-02 21:55:04,522 INFO [Listener at localhost/34483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-02 21:55:04,652 INFO [Listener at localhost/34483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-02 21:55:04,722 DEBUG [Listener at localhost/34483] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-02 21:55:04,808 INFO [Listener at localhost/34483] ipc.NettyRpcServer(120): Bind to /136.243.104.168:40055 2023-11-02 21:55:04,817 INFO [Listener at localhost/34483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-02 21:55:04,819 INFO [Listener at localhost/34483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-02 21:55:04,840 INFO [Listener at localhost/34483] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40055 connecting to ZooKeeper ensemble=127.0.0.1:49550 2023-11-02 21:55:04,973 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:400550x0, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-02 21:55:04,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40055-0x100cf325d340000 connected 2023-11-02 21:55:05,079 DEBUG [Listener at localhost/34483] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-02 21:55:05,080 DEBUG [Listener at localhost/34483] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-02 21:55:05,083 DEBUG [Listener at localhost/34483] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-02 21:55:05,090 DEBUG [Listener at localhost/34483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40055 2023-11-02 21:55:05,090 DEBUG [Listener at localhost/34483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40055 2023-11-02 21:55:05,090 DEBUG [Listener at localhost/34483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40055 2023-11-02 21:55:05,091 DEBUG [Listener at localhost/34483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40055 2023-11-02 21:55:05,091 DEBUG [Listener at localhost/34483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40055 2023-11-02 21:55:05,096 INFO [Listener at localhost/34483] master.HMaster(444): hbase.rootdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16, hbase.cluster.distributed=false 2023-11-02 21:55:05,161 INFO [Listener at localhost/34483] client.ConnectionUtils(127): regionserver/jenkins-hbase12:0 server-side Connection retries=3 2023-11-02 21:55:05,161 INFO [Listener at localhost/34483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-02 21:55:05,162 INFO [Listener at localhost/34483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-02 21:55:05,162 INFO [Listener at localhost/34483] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-02 21:55:05,162 INFO [Listener at localhost/34483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-02 21:55:05,162 INFO [Listener at localhost/34483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-02 21:55:05,166 INFO [Listener at localhost/34483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-02 21:55:05,170 INFO [Listener at localhost/34483] ipc.NettyRpcServer(120): Bind to /136.243.104.168:33583 2023-11-02 21:55:05,171 INFO [Listener at localhost/34483] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-02 21:55:05,177 DEBUG [Listener at localhost/34483] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-02 21:55:05,178 INFO [Listener at localhost/34483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-02 21:55:05,181 INFO [Listener at localhost/34483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-02 21:55:05,183 INFO [Listener at localhost/34483] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33583 connecting to ZooKeeper ensemble=127.0.0.1:49550 2023-11-02 21:55:05,306 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:335830x0, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-02 21:55:05,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33583-0x100cf325d340001 connected 2023-11-02 21:55:05,309 DEBUG [Listener at localhost/34483] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-02 21:55:05,313 DEBUG [Listener at localhost/34483] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-02 21:55:05,315 DEBUG [Listener at localhost/34483] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-02 21:55:05,316 DEBUG [Listener at localhost/34483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33583 2023-11-02 21:55:05,317 DEBUG [Listener at localhost/34483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33583 2023-11-02 21:55:05,317 DEBUG [Listener at localhost/34483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33583 2023-11-02 21:55:05,317 DEBUG [Listener at localhost/34483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33583 2023-11-02 21:55:05,318 DEBUG [Listener at localhost/34483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33583 2023-11-02 21:55:05,320 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase12.apache.org,40055,1698962103892 2023-11-02 21:55:05,361 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-02 21:55:05,365 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase12.apache.org,40055,1698962103892 2023-11-02 21:55:05,431 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-02 21:55:05,431 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-02 21:55:05,431 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-02 21:55:05,433 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-02 21:55:05,435 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase12.apache.org,40055,1698962103892 from backup master directory 2023-11-02 21:55:05,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-02 21:55:05,498 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase12.apache.org,40055,1698962103892 2023-11-02 21:55:05,498 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-02 21:55:05,499 WARN [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-02 21:55:05,500 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase12.apache.org,40055,1698962103892 2023-11-02 21:55:05,506 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-02 21:55:05,508 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-02 21:55:06,002 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/hbase.id with ID: b8d2398a-7df8-44cd-932d-c38ef7839561 2023-11-02 21:55:06,044 INFO [master/jenkins-hbase12:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-02 21:55:06,119 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-02 21:55:06,162 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x25337e57 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:55:06,251 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46f2cfb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:55:06,271 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-02 21:55:06,273 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-02 21:55:06,286 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-02 21:55:06,286 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-02 21:55:06,288 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-02 21:55:06,291 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-02 21:55:06,292 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-02 21:55:06,321 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/data/master/store-tmp 2023-11-02 21:55:06,346 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:06,347 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-02 21:55:06,347 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-02 21:55:06,347 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-02 21:55:06,347 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-02 21:55:06,347 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-02 21:55:06,347 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-02 21:55:06,347 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-02 21:55:06,349 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/WALs/jenkins-hbase12.apache.org,40055,1698962103892 2023-11-02 21:55:06,368 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C40055%2C1698962103892, suffix=, logDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/WALs/jenkins-hbase12.apache.org,40055,1698962103892, archiveDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/oldWALs, maxLogs=10 2023-11-02 21:55:06,419 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36373,DS-dfb1c767-adfe-4b78-a1df-761663cef6b9,DISK] 2023-11-02 21:55:06,426 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-02 21:55:06,493 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/WALs/jenkins-hbase12.apache.org,40055,1698962103892/jenkins-hbase12.apache.org%2C40055%2C1698962103892.1698962106377 2023-11-02 21:55:06,494 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36373,DS-dfb1c767-adfe-4b78-a1df-761663cef6b9,DISK]] 2023-11-02 21:55:06,494 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:55:06,495 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:06,498 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-02 21:55:06,499 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-02 21:55:06,563 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-02 21:55:06,571 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-02 21:55:06,597 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-02 21:55:06,608 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:06,615 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-02 21:55:06,617 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-02 21:55:06,637 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-02 21:55:06,642 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:55:06,643 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64657442, jitterRate=-0.03652903437614441}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:55:06,644 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-02 21:55:06,645 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-02 21:55:06,667 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-02 21:55:06,667 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-02 21:55:06,671 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-02 21:55:06,673 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-02 21:55:06,725 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 51 msec 2023-11-02 21:55:06,725 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-02 21:55:06,751 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-02 21:55:06,757 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-02 21:55:06,788 INFO [master/jenkins-hbase12:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-02 21:55:06,792 INFO [master/jenkins-hbase12:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-02 21:55:06,795 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-02 21:55:06,802 INFO [master/jenkins-hbase12:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-02 21:55:06,807 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-02 21:55:06,867 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-02 21:55:06,869 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-02 21:55:06,869 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-02 21:55:06,883 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-02 21:55:06,898 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-02 21:55:06,898 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-02 21:55:06,898 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-02 21:55:06,899 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase12.apache.org,40055,1698962103892, sessionid=0x100cf325d340000, setting cluster-up flag (Was=false) 2023-11-02 21:55:06,935 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-02 21:55:06,967 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-02 21:55:06,969 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase12.apache.org,40055,1698962103892 2023-11-02 21:55:06,993 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-02 21:55:07,025 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-02 21:55:07,026 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase12.apache.org,40055,1698962103892 2023-11-02 21:55:07,028 WARN [master/jenkins-hbase12:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp 2023-11-02 21:55:07,138 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(951): ClusterId : b8d2398a-7df8-44cd-932d-c38ef7839561 2023-11-02 21:55:07,142 DEBUG [RS:0;jenkins-hbase12:33583] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-02 21:55:07,162 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-02 21:55:07,163 DEBUG [RS:0;jenkins-hbase12:33583] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-02 21:55:07,163 DEBUG [RS:0;jenkins-hbase12:33583] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-02 21:55:07,175 DEBUG [RS:0;jenkins-hbase12:33583] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-02 21:55:07,177 DEBUG [RS:0;jenkins-hbase12:33583] zookeeper.ReadOnlyZKClient(139): Connect 0x457d166a to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:55:07,186 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-11-02 21:55:07,186 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-11-02 21:55:07,186 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-11-02 21:55:07,186 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-11-02 21:55:07,187 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase12:0, corePoolSize=10, maxPoolSize=10 2023-11-02 21:55:07,187 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,187 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=2, maxPoolSize=2 2023-11-02 21:55:07,187 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,202 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1698962137202 2023-11-02 21:55:07,206 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-02 21:55:07,206 DEBUG [RS:0;jenkins-hbase12:33583] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bbaf0b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:55:07,207 DEBUG [RS:0;jenkins-hbase12:33583] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f857d1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase12.apache.org/136.243.104.168:0 2023-11-02 21:55:07,209 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-02 21:55:07,210 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-02 21:55:07,215 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-02 21:55:07,219 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-02 21:55:07,229 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-02 21:55:07,229 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-02 21:55:07,230 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-02 21:55:07,230 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-02 21:55:07,231 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:07,233 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-02 21:55:07,235 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-02 21:55:07,235 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-02 21:55:07,237 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase12:33583 2023-11-02 21:55:07,238 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-02 21:55:07,239 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-02 21:55:07,243 INFO [RS:0;jenkins-hbase12:33583] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-02 21:55:07,243 INFO [RS:0;jenkins-hbase12:33583] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-02 21:55:07,243 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1022): About to register with Master. 2023-11-02 21:55:07,243 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1698962107241,5,FailOnTimeoutGroup] 2023-11-02 21:55:07,244 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1698962107244,5,FailOnTimeoutGroup] 2023-11-02 21:55:07,244 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:07,244 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-02 21:55:07,245 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase12.apache.org,40055,1698962103892 with isa=jenkins-hbase12.apache.org/136.243.104.168:33583, startcode=1698962105160 2023-11-02 21:55:07,246 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:07,246 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:07,263 DEBUG [RS:0;jenkins-hbase12:33583] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-02 21:55:07,314 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:38939, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-02 21:55:07,327 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40055] master.ServerManager(388): Registering regionserver=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:07,340 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16 2023-11-02 21:55:07,340 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34899 2023-11-02 21:55:07,340 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-02 21:55:07,356 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-02 21:55:07,358 DEBUG [RS:0;jenkins-hbase12:33583] zookeeper.ZKUtil(162): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:07,358 WARN [RS:0;jenkins-hbase12:33583] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-02 21:55:07,358 INFO [RS:0;jenkins-hbase12:33583] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-02 21:55:07,359 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/WALs/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:07,359 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase12.apache.org,33583,1698962105160] 2023-11-02 21:55:07,369 DEBUG [RS:0;jenkins-hbase12:33583] zookeeper.ZKUtil(162): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:07,379 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-02 21:55:07,386 INFO [RS:0;jenkins-hbase12:33583] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-02 21:55:07,406 INFO [RS:0;jenkins-hbase12:33583] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-02 21:55:07,410 INFO [RS:0;jenkins-hbase12:33583] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:55:07,411 INFO [RS:0;jenkins-hbase12:33583] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:07,412 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-02 21:55:07,419 INFO [RS:0;jenkins-hbase12:33583] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-02 21:55:07,420 DEBUG [RS:0;jenkins-hbase12:33583] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,420 DEBUG [RS:0;jenkins-hbase12:33583] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,420 DEBUG [RS:0;jenkins-hbase12:33583] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,420 DEBUG [RS:0;jenkins-hbase12:33583] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,421 DEBUG [RS:0;jenkins-hbase12:33583] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,421 DEBUG [RS:0;jenkins-hbase12:33583] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase12:0, corePoolSize=2, maxPoolSize=2 2023-11-02 21:55:07,421 DEBUG [RS:0;jenkins-hbase12:33583] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,421 DEBUG [RS:0;jenkins-hbase12:33583] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,421 DEBUG [RS:0;jenkins-hbase12:33583] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,422 DEBUG [RS:0;jenkins-hbase12:33583] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-11-02 21:55:07,425 INFO [RS:0;jenkins-hbase12:33583] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:07,425 INFO [RS:0;jenkins-hbase12:33583] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:07,425 INFO [RS:0;jenkins-hbase12:33583] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:07,442 INFO [RS:0;jenkins-hbase12:33583] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-02 21:55:07,444 INFO [RS:0;jenkins-hbase12:33583] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,33583,1698962105160-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:07,460 INFO [RS:0;jenkins-hbase12:33583] regionserver.Replication(203): jenkins-hbase12.apache.org,33583,1698962105160 started 2023-11-02 21:55:07,461 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1637): Serving as jenkins-hbase12.apache.org,33583,1698962105160, RpcServer on jenkins-hbase12.apache.org/136.243.104.168:33583, sessionid=0x100cf325d340001 2023-11-02 21:55:07,461 DEBUG [RS:0;jenkins-hbase12:33583] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-02 21:55:07,461 DEBUG [RS:0;jenkins-hbase12:33583] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:07,461 DEBUG [RS:0;jenkins-hbase12:33583] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase12.apache.org,33583,1698962105160' 2023-11-02 21:55:07,461 DEBUG [RS:0;jenkins-hbase12:33583] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:07,463 DEBUG [RS:0;jenkins-hbase12:33583] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:07,463 DEBUG [RS:0;jenkins-hbase12:33583] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-02 21:55:07,463 DEBUG [RS:0;jenkins-hbase12:33583] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-02 21:55:07,463 DEBUG [RS:0;jenkins-hbase12:33583] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:07,463 DEBUG [RS:0;jenkins-hbase12:33583] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase12.apache.org,33583,1698962105160' 2023-11-02 21:55:07,463 DEBUG [RS:0;jenkins-hbase12:33583] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-02 21:55:07,464 DEBUG [RS:0;jenkins-hbase12:33583] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-02 21:55:07,465 DEBUG [RS:0;jenkins-hbase12:33583] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-02 21:55:07,465 INFO [RS:0;jenkins-hbase12:33583] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-02 21:55:07,465 INFO [RS:0;jenkins-hbase12:33583] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-02 21:55:07,574 INFO [RS:0;jenkins-hbase12:33583] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C33583%2C1698962105160, suffix=, logDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/WALs/jenkins-hbase12.apache.org,33583,1698962105160, archiveDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/oldWALs, maxLogs=32 2023-11-02 21:55:07,595 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36373,DS-dfb1c767-adfe-4b78-a1df-761663cef6b9,DISK] 2023-11-02 21:55:07,599 INFO [RS:0;jenkins-hbase12:33583] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/WALs/jenkins-hbase12.apache.org,33583,1698962105160/jenkins-hbase12.apache.org%2C33583%2C1698962105160.1698962107577 2023-11-02 21:55:07,600 DEBUG [RS:0;jenkins-hbase12:33583] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36373,DS-dfb1c767-adfe-4b78-a1df-761663cef6b9,DISK]] 2023-11-02 21:55:07,661 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-02 21:55:07,662 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-02 21:55:07,662 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16 2023-11-02 21:55:07,679 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:07,681 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-02 21:55:07,684 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/info 2023-11-02 21:55:07,685 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-02 21:55:07,686 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:07,687 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-02 21:55:07,690 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/rep_barrier 2023-11-02 21:55:07,690 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-02 21:55:07,691 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:07,691 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-02 21:55:07,693 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/table 2023-11-02 21:55:07,694 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-02 21:55:07,695 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:07,696 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740 2023-11-02 21:55:07,697 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740 2023-11-02 21:55:07,700 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-02 21:55:07,702 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-02 21:55:07,705 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:55:07,706 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73323807, jitterRate=0.09260986745357513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-02 21:55:07,706 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-02 21:55:07,706 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-02 21:55:07,706 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-02 21:55:07,706 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-02 21:55:07,706 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-02 21:55:07,706 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-02 21:55:07,707 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-02 21:55:07,707 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-02 21:55:07,712 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-02 21:55:07,712 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-02 21:55:07,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-02 21:55:07,731 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-02 21:55:07,733 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-02 21:55:07,884 DEBUG [jenkins-hbase12:40055] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-02 21:55:07,887 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase12.apache.org,33583,1698962105160, state=OPENING 2023-11-02 21:55:07,936 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-02 21:55:08,003 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-02 21:55:08,004 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-02 21:55:08,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:55:08,189 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:08,191 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-02 21:55:08,195 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-02 21:55:08,205 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-02 21:55:08,205 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-02 21:55:08,209 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C33583%2C1698962105160.meta, suffix=.meta, logDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/WALs/jenkins-hbase12.apache.org,33583,1698962105160, archiveDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/oldWALs, maxLogs=32 2023-11-02 21:55:08,226 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36373,DS-dfb1c767-adfe-4b78-a1df-761663cef6b9,DISK] 2023-11-02 21:55:08,230 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/WALs/jenkins-hbase12.apache.org,33583,1698962105160/jenkins-hbase12.apache.org%2C33583%2C1698962105160.meta.1698962108211.meta 2023-11-02 21:55:08,232 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36373,DS-dfb1c767-adfe-4b78-a1df-761663cef6b9,DISK]] 2023-11-02 21:55:08,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:55:08,234 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-02 21:55:08,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-02 21:55:08,256 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-02 21:55:08,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-02 21:55:08,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:08,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-02 21:55:08,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-02 21:55:08,265 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-02 21:55:08,266 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/info 2023-11-02 21:55:08,267 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/info 2023-11-02 21:55:08,267 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-02 21:55:08,268 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:08,268 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-02 21:55:08,270 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/rep_barrier 2023-11-02 21:55:08,270 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/rep_barrier 2023-11-02 21:55:08,270 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-02 21:55:08,271 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:08,272 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-02 21:55:08,273 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/table 2023-11-02 21:55:08,273 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/table 2023-11-02 21:55:08,274 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-02 21:55:08,274 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:08,276 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740 2023-11-02 21:55:08,278 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740 2023-11-02 21:55:08,281 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-02 21:55:08,283 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-02 21:55:08,284 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73918499, jitterRate=0.10147146880626678}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-02 21:55:08,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-02 21:55:08,294 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1698962108184 2023-11-02 21:55:08,309 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-02 21:55:08,309 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-02 21:55:08,310 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase12.apache.org,33583,1698962105160, state=OPEN 2023-11-02 21:55:08,397 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-02 21:55:08,397 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-02 21:55:08,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-02 21:55:08,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase12.apache.org,33583,1698962105160 in 391 msec 2023-11-02 21:55:08,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-02 21:55:08,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 686 msec 2023-11-02 21:55:08,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3430 sec 2023-11-02 21:55:08,416 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1698962108416, completionTime=-1 2023-11-02 21:55:08,416 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-02 21:55:08,417 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-02 21:55:08,470 DEBUG [hconnection-0x5bbecbeb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:55:08,474 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:55:08,490 INFO [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-02 21:55:08,490 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1698962168490 2023-11-02 21:55:08,490 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1698962228490 2023-11-02 21:55:08,490 INFO [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 73 msec 2023-11-02 21:55:08,639 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,40055,1698962103892-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:08,639 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,40055,1698962103892-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:08,639 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,40055,1698962103892-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:08,642 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase12:40055, period=300000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:08,643 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-02 21:55:08,651 DEBUG [master/jenkins-hbase12:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-02 21:55:08,659 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-02 21:55:08,660 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-02 21:55:08,668 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-02 21:55:08,670 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:55:08,672 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:55:08,689 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:55:08,691 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0 empty. 2023-11-02 21:55:08,691 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:55:08,691 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-02 21:55:09,116 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-02 21:55:09,121 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => dc68987b77885ebafbaa8da888a20bd0, NAME => 'hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:55:09,539 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:09,539 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing dc68987b77885ebafbaa8da888a20bd0, disabling compactions & flushes 2023-11-02 21:55:09,540 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:55:09,540 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:55:09,540 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. after waiting 0 ms 2023-11-02 21:55:09,540 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:55:09,540 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:55:09,540 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for dc68987b77885ebafbaa8da888a20bd0: 2023-11-02 21:55:09,546 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:55:09,562 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698962109549"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962109549"}]},"ts":"1698962109549"} 2023-11-02 21:55:09,590 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-02 21:55:09,593 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:55:09,597 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962109593"}]},"ts":"1698962109593"} 2023-11-02 21:55:09,602 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-02 21:55:09,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dc68987b77885ebafbaa8da888a20bd0, ASSIGN}] 2023-11-02 21:55:09,680 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dc68987b77885ebafbaa8da888a20bd0, ASSIGN 2023-11-02 21:55:09,682 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=dc68987b77885ebafbaa8da888a20bd0, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:55:09,833 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dc68987b77885ebafbaa8da888a20bd0, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:09,834 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698962109833"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962109833"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962109833"}]},"ts":"1698962109833"} 2023-11-02 21:55:09,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure dc68987b77885ebafbaa8da888a20bd0, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:55:09,993 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:09,999 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:55:10,000 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc68987b77885ebafbaa8da888a20bd0, NAME => 'hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:55:10,001 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:55:10,001 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:10,001 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:55:10,001 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:55:10,003 INFO [StoreOpener-dc68987b77885ebafbaa8da888a20bd0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:55:10,005 DEBUG [StoreOpener-dc68987b77885ebafbaa8da888a20bd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0/info 2023-11-02 21:55:10,005 DEBUG [StoreOpener-dc68987b77885ebafbaa8da888a20bd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0/info 2023-11-02 21:55:10,006 INFO [StoreOpener-dc68987b77885ebafbaa8da888a20bd0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc68987b77885ebafbaa8da888a20bd0 columnFamilyName info 2023-11-02 21:55:10,007 INFO [StoreOpener-dc68987b77885ebafbaa8da888a20bd0-1] regionserver.HStore(310): Store=dc68987b77885ebafbaa8da888a20bd0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:10,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:55:10,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:55:10,014 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:55:10,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:55:10,020 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened dc68987b77885ebafbaa8da888a20bd0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73938803, jitterRate=0.10177402198314667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:55:10,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for dc68987b77885ebafbaa8da888a20bd0: 2023-11-02 21:55:10,022 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0., pid=6, masterSystemTime=1698962109993 2023-11-02 21:55:10,026 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:55:10,026 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:55:10,028 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dc68987b77885ebafbaa8da888a20bd0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:10,028 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698962110027"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962110027"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962110027"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962110027"}]},"ts":"1698962110027"} 2023-11-02 21:55:10,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-02 21:55:10,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure dc68987b77885ebafbaa8da888a20bd0, server=jenkins-hbase12.apache.org,33583,1698962105160 in 196 msec 2023-11-02 21:55:10,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-02 21:55:10,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=dc68987b77885ebafbaa8da888a20bd0, ASSIGN in 364 msec 2023-11-02 21:55:10,043 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:55:10,043 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962110043"}]},"ts":"1698962110043"} 2023-11-02 21:55:10,047 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-02 21:55:10,063 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:55:10,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.4020 sec 2023-11-02 21:55:10,072 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-02 21:55:10,082 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-02 21:55:10,082 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-02 21:55:10,117 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-02 21:55:10,140 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-02 21:55:10,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 44 msec 2023-11-02 21:55:10,161 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-02 21:55:10,182 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-02 21:55:10,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 35 msec 2023-11-02 21:55:10,224 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-02 21:55:10,246 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-02 21:55:10,249 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.749sec 2023-11-02 21:55:10,252 INFO [master/jenkins-hbase12:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-02 21:55:10,254 INFO [master/jenkins-hbase12:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-02 21:55:10,254 INFO [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-02 21:55:10,255 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,40055,1698962103892-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-02 21:55:10,256 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,40055,1698962103892-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-02 21:55:10,267 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-02 21:55:10,340 DEBUG [Listener at localhost/34483] zookeeper.ReadOnlyZKClient(139): Connect 0x0939b377 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:55:10,389 DEBUG [Listener at localhost/34483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c744150, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:55:10,408 DEBUG [hconnection-0x59c0d5fb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:55:10,417 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:54782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:55:10,425 INFO [Listener at localhost/34483] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase12.apache.org,40055,1698962103892 2023-11-02 21:55:10,427 DEBUG [Listener at localhost/34483] zookeeper.ReadOnlyZKClient(139): Connect 0x75a6f40a to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:55:10,441 DEBUG [Listener at localhost/34483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c854149, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:55:10,442 INFO [Listener at localhost/34483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-02 21:55:10,481 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=214, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=174, AvailableMemoryMB=1403 2023-11-02 21:55:10,495 DEBUG [Listener at localhost/34483] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:55:10,498 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:41556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:55:10,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-02 21:55:10,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:10,516 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:55:10,519 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:55:10,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-02 21:55:10,522 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:10,523 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641 empty. 2023-11-02 21:55:10,525 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:10,525 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-02 21:55:10,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-02 21:55:10,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-02 21:55:10,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-02 21:55:10,945 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-02 21:55:10,948 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 78fa04c7b43844795d0ffcceeb0aa641, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:55:11,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-02 21:55:11,362 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:11,363 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 78fa04c7b43844795d0ffcceeb0aa641, disabling compactions & flushes 2023-11-02 21:55:11,363 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:11,363 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:11,363 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. after waiting 0 ms 2023-11-02 21:55:11,363 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:11,363 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:11,363 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:11,367 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:55:11,369 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698962111369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962111369"}]},"ts":"1698962111369"} 2023-11-02 21:55:11,371 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-02 21:55:11,373 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:55:11,373 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962111373"}]},"ts":"1698962111373"} 2023-11-02 21:55:11,376 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-02 21:55:11,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78fa04c7b43844795d0ffcceeb0aa641, ASSIGN}] 2023-11-02 21:55:11,438 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78fa04c7b43844795d0ffcceeb0aa641, ASSIGN 2023-11-02 21:55:11,439 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78fa04c7b43844795d0ffcceeb0aa641, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:55:11,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=78fa04c7b43844795d0ffcceeb0aa641, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:11,592 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698962111591"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962111591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962111591"}]},"ts":"1698962111591"} 2023-11-02 21:55:11,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 78fa04c7b43844795d0ffcceeb0aa641, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:55:11,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-02 21:55:11,751 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:11,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:11,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 78fa04c7b43844795d0ffcceeb0aa641, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:55:11,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:11,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:11,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:11,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:11,762 INFO [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:11,765 DEBUG [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1 2023-11-02 21:55:11,765 DEBUG [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1 2023-11-02 21:55:11,769 INFO [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78fa04c7b43844795d0ffcceeb0aa641 columnFamilyName family1 2023-11-02 21:55:11,773 INFO [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] regionserver.HStore(310): Store=78fa04c7b43844795d0ffcceeb0aa641/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:11,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:11,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:11,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:11,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:55:11,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 78fa04c7b43844795d0ffcceeb0aa641; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73895331, jitterRate=0.10112623870372772}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:55:11,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:11,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641., pid=11, masterSystemTime=1698962111751 2023-11-02 21:55:11,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:11,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:11,794 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=78fa04c7b43844795d0ffcceeb0aa641, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:11,794 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698962111794"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962111794"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962111794"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962111794"}]},"ts":"1698962111794"} 2023-11-02 21:55:11,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-02 21:55:11,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 78fa04c7b43844795d0ffcceeb0aa641, server=jenkins-hbase12.apache.org,33583,1698962105160 in 202 msec 2023-11-02 21:55:11,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-02 21:55:11,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78fa04c7b43844795d0ffcceeb0aa641, ASSIGN in 366 msec 2023-11-02 21:55:11,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:55:11,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962111807"}]},"ts":"1698962111807"} 2023-11-02 21:55:11,809 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-02 21:55:11,821 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:55:11,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.3090 sec 2023-11-02 21:55:12,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-02 21:55:12,650 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-02 21:55:12,671 DEBUG [hconnection-0x60d5912f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:55:12,674 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:54788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:55:12,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:12,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:12,851 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:12,852 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:12,852 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-02 21:55:12,852 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-02 21:55:12,853 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:12,853 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:12,898 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:12,898 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:12,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:12,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:12,899 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:12,899 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:12,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:12,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:12,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:12,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:12,900 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:12,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:12,902 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-02 21:55:12,902 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:12,903 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-02 21:55:12,904 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:12,904 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:12,904 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:12,905 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. started... 2023-11-02 21:55:12,906 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 78fa04c7b43844795d0ffcceeb0aa641 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-02 21:55:13,460 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ef053d78f2fa41dd9b2cc4684096819c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130ef053d78f2fa41dd9b2cc4684096819c 2023-11-02 21:55:13,482 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/a7074a23948c4d1496d0743468b54b93 2023-11-02 21:55:13,495 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/a7074a23948c4d1496d0743468b54b93 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/a7074a23948c4d1496d0743468b54b93 2023-11-02 21:55:13,506 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/a7074a23948c4d1496d0743468b54b93, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-02 21:55:13,510 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 78fa04c7b43844795d0ffcceeb0aa641 in 605ms, sequenceid=5, compaction requested=false 2023-11-02 21:55:13,511 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:13,514 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:13,514 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:13,514 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:13,514 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:13,514 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,514 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-02 21:55:13,514 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-02 21:55:13,529 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,529 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:13,530 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,530 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:13,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:13,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-02 21:55:13,534 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-02 21:55:13,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ec68625[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:13,534 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,545 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,546 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-02 21:55:13,546 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-02 21:55:13,546 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:13,546 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,547 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:13,561 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-02 21:55:13,561 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,561 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:13,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:13,561 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-02 21:55:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:13,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-02 21:55:13,566 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-02 21:55:13,566 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:13,566 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:13,566 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,566 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:13,577 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,577 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:13,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,577 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:13,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:13,578 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:13,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:13,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:13,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,581 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:13,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,603 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,603 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,603 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:13,603 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,603 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:13,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:13,603 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,603 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,603 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:13,604 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,604 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:13,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:13,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:13,607 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:13,607 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:13,707 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:13,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:13,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:13,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:13,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,724 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:13,724 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:13,725 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-02 21:55:13,725 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-02 21:55:13,726 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,726 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,793 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:55:13,807 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,807 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:13,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:13,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:13,807 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:13,807 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:13,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:13,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,809 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,809 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-02 21:55:13,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:13,810 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-02 21:55:13,810 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:13,810 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-02 21:55:13,811 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:13,811 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:13,811 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:13,811 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. started... 2023-11-02 21:55:13,811 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 78fa04c7b43844795d0ffcceeb0aa641 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-02 21:55:13,867 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-02 21:55:13,869 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-02 21:55:14,094 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-02 21:55:14,095 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-02 21:55:14,258 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285de41ac38c9e4c3081baf457cb7bc798 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285de41ac38c9e4c3081baf457cb7bc798 2023-11-02 21:55:14,675 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/6a374295223e4bb7bd022fc66b18224b 2023-11-02 21:55:14,684 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/6a374295223e4bb7bd022fc66b18224b as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/6a374295223e4bb7bd022fc66b18224b 2023-11-02 21:55:14,692 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/6a374295223e4bb7bd022fc66b18224b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-02 21:55:14,693 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 78fa04c7b43844795d0ffcceeb0aa641 in 882ms, sequenceid=9, compaction requested=false 2023-11-02 21:55:14,693 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:14,693 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:14,693 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:14,694 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:14,694 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,694 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-02 21:55:14,694 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-02 21:55:14,703 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,703 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:14,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:14,704 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,704 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:14,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:14,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:14,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:14,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-02 21:55:14,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6744206d[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:14,708 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-02 21:55:14,708 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,719 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,719 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-02 21:55:14,719 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-02 21:55:14,719 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:14,719 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,719 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:14,729 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-02 21:55:14,730 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:14,730 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-02 21:55:14,729 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:14,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:14,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:14,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:14,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-02 21:55:14,740 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-02 21:55:14,740 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:14,740 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:14,740 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,740 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:14,750 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,750 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:14,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:14,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,750 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:14,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:14,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:14,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:14,752 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,755 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:14,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,772 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,772 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:14,772 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:14,772 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,772 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:14,772 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:14,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:14,772 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:14,772 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:14,773 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:14,774 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,774 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:14,774 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:14,874 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:14,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:14,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:14,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:14,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,894 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:14,894 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:14,894 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-02 21:55:14,895 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-02 21:55:14,895 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,895 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,908 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:14,908 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:14,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:14,909 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:14,909 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:14,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:14,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,911 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,911 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-02 21:55:14,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:14,912 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-02 21:55:14,912 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:14,912 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-02 21:55:14,913 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:14,913 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:14,913 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:14,913 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. started... 2023-11-02 21:55:14,913 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 78fa04c7b43844795d0ffcceeb0aa641 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:15,353 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120146c81331dba64413b9793edd18a9ce9a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120146c81331dba64413b9793edd18a9ce9a 2023-11-02 21:55:15,768 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/2b55f3f9409746359b5a8bd804820dba 2023-11-02 21:55:15,779 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/2b55f3f9409746359b5a8bd804820dba as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/2b55f3f9409746359b5a8bd804820dba 2023-11-02 21:55:15,786 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/2b55f3f9409746359b5a8bd804820dba, entries=1, sequenceid=13, filesize=5.0 K 2023-11-02 21:55:15,787 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78fa04c7b43844795d0ffcceeb0aa641 in 874ms, sequenceid=13, compaction requested=true 2023-11-02 21:55:15,787 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:15,788 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:15,788 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:15,788 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:15,788 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,788 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-02 21:55:15,788 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-02 21:55:15,845 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,845 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:15,846 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:15,846 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:15,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-02 21:55:15,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3449156a[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:15,852 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-02 21:55:15,853 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,861 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,862 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-02 21:55:15,862 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-02 21:55:15,862 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:15,862 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,863 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:15,876 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,877 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-02 21:55:15,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:15,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:15,877 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:15,877 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-02 21:55:15,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:15,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:15,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:15,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:15,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-02 21:55:15,882 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-02 21:55:15,882 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:15,882 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:15,882 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,882 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:15,893 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,893 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,893 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:15,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:15,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:15,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:15,894 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,895 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,908 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,908 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:15,908 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:15,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:15,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:15,908 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:15,908 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,908 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:15,909 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:15,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:15,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-02 21:55:15,909 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,909 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,909 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:15,909 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:15,909 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:15,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:15,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:16,010 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:16,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:16,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:16,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:16,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,022 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:16,022 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:16,023 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-02 21:55:16,023 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-02 21:55:16,023 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,023 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,034 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:16,034 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:16,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:16,035 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,035 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:16,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:16,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,037 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-02 21:55:16,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,037 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-02 21:55:16,037 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:16,038 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-02 21:55:16,038 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:16,038 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:16,038 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:16,038 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. started... 2023-11-02 21:55:16,038 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 78fa04c7b43844795d0ffcceeb0aa641 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:16,467 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a5db3a229ab24556b53cc077b9b2f143 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a5db3a229ab24556b53cc077b9b2f143 2023-11-02 21:55:16,893 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/4e7c43b2a6bd47878fe481d22b79fde0 2023-11-02 21:55:16,907 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/4e7c43b2a6bd47878fe481d22b79fde0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/4e7c43b2a6bd47878fe481d22b79fde0 2023-11-02 21:55:16,918 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/4e7c43b2a6bd47878fe481d22b79fde0, entries=1, sequenceid=17, filesize=5.0 K 2023-11-02 21:55:16,919 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78fa04c7b43844795d0ffcceeb0aa641 in 881ms, sequenceid=17, compaction requested=true 2023-11-02 21:55:16,919 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:16,919 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:16,919 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:16,920 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:16,920 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,920 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-02 21:55:16,920 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-02 21:55:16,941 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,941 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:16,941 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,941 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:16,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:16,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:16,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:16,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-02 21:55:16,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72a4307e[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:16,945 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-02 21:55:16,945 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,956 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,956 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-02 21:55:16,956 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-02 21:55:16,956 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,956 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:16,956 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:16,966 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-02 21:55:16,966 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:16,966 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-02 21:55:16,966 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:16,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:16,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:16,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:16,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:16,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:16,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-02 21:55:16,972 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-02 21:55:16,973 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:16,973 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:16,973 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:16,973 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:17,012 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,012 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,013 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:17,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:17,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:17,015 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:17,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:17,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:17,019 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:17,045 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:17,045 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:17,045 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,045 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:17,045 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:17,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:17,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:17,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:17,045 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:17,046 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:17,046 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,046 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,047 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,047 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:17,047 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:17,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:17,147 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:17,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:17,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:17,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:17,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,163 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:17,163 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:17,164 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-02 21:55:17,164 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-02 21:55:17,165 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,165 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,177 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:17,177 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:17,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:17,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:17,177 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:17,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,177 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:17,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,179 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,179 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-02 21:55:17,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:17,179 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-02 21:55:17,179 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:17,180 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-02 21:55:17,180 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:17,180 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:17,180 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:17,180 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. started... 2023-11-02 21:55:17,180 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 78fa04c7b43844795d0ffcceeb0aa641 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:17,609 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228799a84e2ad964b46820c86c69f79c0fe to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228799a84e2ad964b46820c86c69f79c0fe 2023-11-02 21:55:18,022 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/731a435356de481e84b6986c467c2cd2 2023-11-02 21:55:18,031 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/731a435356de481e84b6986c467c2cd2 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/731a435356de481e84b6986c467c2cd2 2023-11-02 21:55:18,039 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/731a435356de481e84b6986c467c2cd2, entries=1, sequenceid=21, filesize=5.0 K 2023-11-02 21:55:18,040 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78fa04c7b43844795d0ffcceeb0aa641 in 860ms, sequenceid=21, compaction requested=true 2023-11-02 21:55:18,040 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:18,040 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:18,040 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:18,041 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:18,041 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,042 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-02 21:55:18,042 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-02 21:55:18,124 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,124 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:18,126 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,126 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:18,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:18,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:18,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-02 21:55:18,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78d967a1[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:18,131 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-02 21:55:18,131 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,211 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,212 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-02 21:55:18,212 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-02 21:55:18,212 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:18,212 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,212 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:18,250 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-02 21:55:18,250 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:18,250 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,251 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-02 21:55:18,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:18,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:18,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:18,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:18,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:18,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:18,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-02 21:55:18,255 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-02 21:55:18,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:18,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:18,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,255 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:18,271 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,271 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,271 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:18,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:18,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:18,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,272 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:18,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:18,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:18,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,273 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,287 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:18,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:18,287 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:18,287 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,287 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,287 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,287 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,287 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,287 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:18,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-02 21:55:18,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:18,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:18,287 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,288 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:18,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:18,289 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:18,289 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:18,389 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:18,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:18,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:18,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:18,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,400 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:18,400 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:18,400 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-02 21:55:18,400 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-02 21:55:18,401 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,401 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,413 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,413 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:18,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:18,414 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,414 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:18,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,416 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,416 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-02 21:55:18,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:18,416 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-02 21:55:18,416 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:18,417 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-02 21:55:18,417 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:18,417 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:18,417 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:18,417 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. started... 2023-11-02 21:55:18,417 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 78fa04c7b43844795d0ffcceeb0aa641 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:18,448 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123149990edf34b443ce8abafd9e075aa8dc to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123149990edf34b443ce8abafd9e075aa8dc 2023-11-02 21:55:18,862 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/35412b1868a140b3bbb4471b1b365d64 2023-11-02 21:55:18,873 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/35412b1868a140b3bbb4471b1b365d64 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/35412b1868a140b3bbb4471b1b365d64 2023-11-02 21:55:18,882 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/35412b1868a140b3bbb4471b1b365d64, entries=1, sequenceid=25, filesize=5.0 K 2023-11-02 21:55:18,884 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78fa04c7b43844795d0ffcceeb0aa641 in 467ms, sequenceid=25, compaction requested=true 2023-11-02 21:55:18,885 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:18,885 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:18,885 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:18,885 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:18,885 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:18,885 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-02 21:55:18,885 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-02 21:55:19,045 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,045 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:19,045 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,045 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:19,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-02 21:55:19,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e58779f[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:19,048 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-02 21:55:19,048 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,055 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,055 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-02 21:55:19,056 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-02 21:55:19,056 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:19,056 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,056 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:19,066 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-02 21:55:19,066 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:19,066 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-02 21:55:19,066 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:19,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:19,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:19,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:19,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:19,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:19,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-02 21:55:19,070 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-02 21:55:19,070 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:19,070 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:19,070 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,070 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:19,082 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,082 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:19,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,082 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:19,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,088 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,092 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,103 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,103 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:19,103 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:19,103 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:19,103 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:19,103 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,103 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,104 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:19,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:19,104 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:19,104 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:19,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:19,105 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:19,105 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:19,205 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:19,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:19,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:19,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:19,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,218 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:19,218 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:19,219 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-02 21:55:19,219 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-02 21:55:19,220 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,220 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,262 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,262 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:19,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:19,263 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,263 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:19,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:19,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,265 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-02 21:55:19,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,265 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-02 21:55:19,265 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:19,265 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-02 21:55:19,265 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:19,266 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:19,266 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:19,266 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. started... 2023-11-02 21:55:19,266 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 78fa04c7b43844795d0ffcceeb0aa641 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:19,730 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101823e42f598b44a50bca9eb97f8da9c3e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101823e42f598b44a50bca9eb97f8da9c3e 2023-11-02 21:55:19,740 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/30f1f14e8d8b44a1a3662f217711638d 2023-11-02 21:55:19,750 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/30f1f14e8d8b44a1a3662f217711638d as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/30f1f14e8d8b44a1a3662f217711638d 2023-11-02 21:55:19,760 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/30f1f14e8d8b44a1a3662f217711638d, entries=1, sequenceid=29, filesize=5.0 K 2023-11-02 21:55:19,761 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78fa04c7b43844795d0ffcceeb0aa641 in 495ms, sequenceid=29, compaction requested=true 2023-11-02 21:55:19,762 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:19,762 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:19,762 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:19,763 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:19,763 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,763 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-02 21:55:19,763 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-02 21:55:19,813 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,813 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:19,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:19,814 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:19,814 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:19,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:19,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:19,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-02 21:55:19,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4246d77b[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:19,816 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-02 21:55:19,816 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,829 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,830 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-02 21:55:19,830 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-02 21:55:19,830 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,830 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:19,830 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:19,840 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-02 21:55:19,840 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,840 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:19,840 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-02 21:55:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:19,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:19,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:19,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:19,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:19,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:19,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-02 21:55:19,844 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-02 21:55:19,844 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:19,844 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:19,845 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,845 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:19,855 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,855 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:19,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,855 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:19,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:19,856 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:19,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,857 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:19,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,866 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,866 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,866 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:19,866 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:19,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:19,866 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:19,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-02 21:55:19,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:19,866 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:19,866 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:19,866 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,866 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:19,867 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,867 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:19,867 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:19,967 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:19,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:19,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:19,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:19,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,987 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:19,988 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:19,988 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-02 21:55:19,988 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-02 21:55:19,989 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:19,989 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,027 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:20,027 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:20,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:20,028 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,028 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:20,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:20,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,031 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,032 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-02 21:55:20,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,032 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-02 21:55:20,032 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:20,033 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-02 21:55:20,033 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:20,033 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:20,034 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:20,034 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. started... 2023-11-02 21:55:20,034 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 78fa04c7b43844795d0ffcceeb0aa641 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:20,462 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010310a0437d98784df39a1e014332c6bc72 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010310a0437d98784df39a1e014332c6bc72 2023-11-02 21:55:20,470 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/abfe2291c68c4224b18ec9fdde191b13 2023-11-02 21:55:20,478 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/abfe2291c68c4224b18ec9fdde191b13 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/abfe2291c68c4224b18ec9fdde191b13 2023-11-02 21:55:20,485 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/abfe2291c68c4224b18ec9fdde191b13, entries=1, sequenceid=33, filesize=5.0 K 2023-11-02 21:55:20,486 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78fa04c7b43844795d0ffcceeb0aa641 in 452ms, sequenceid=33, compaction requested=true 2023-11-02 21:55:20,486 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:20,486 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:20,486 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:20,487 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:20,487 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,487 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-02 21:55:20,487 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-02 21:55:20,508 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,508 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:20,508 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,509 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:20,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-02 21:55:20,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1132288d[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:20,510 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-02 21:55:20,510 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,518 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,519 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-02 21:55:20,519 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-02 21:55:20,519 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,519 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:20,519 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:20,529 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-02 21:55:20,529 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,529 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:20,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:20,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:20,529 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-02 21:55:20,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:20,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-02 21:55:20,533 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-02 21:55:20,533 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:20,534 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:20,534 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,534 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:20,545 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,545 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,545 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:20,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:20,546 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,550 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,560 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,560 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:20,560 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:20,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:20,561 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,561 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:20,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:20,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:20,561 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:20,561 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,561 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,561 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:20,562 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,562 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:20,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:20,562 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:20,662 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:20,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:20,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:20,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:20,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,676 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:20,676 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:20,677 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-02 21:55:20,677 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-02 21:55:20,677 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,677 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,687 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,687 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:20,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:20,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:20,687 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:20,687 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:20,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:20,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,689 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,689 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-02 21:55:20,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:20,690 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-02 21:55:20,690 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:20,690 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-02 21:55:20,692 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:20,692 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:20,692 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:20,692 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. started... 2023-11-02 21:55:20,692 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 78fa04c7b43844795d0ffcceeb0aa641 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:21,114 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907281648679d4549c0a7b5b19c0f8d0a64 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907281648679d4549c0a7b5b19c0f8d0a64 2023-11-02 21:55:21,522 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/cdfe737a2bc443609f91c25338f741d5 2023-11-02 21:55:21,532 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/cdfe737a2bc443609f91c25338f741d5 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/cdfe737a2bc443609f91c25338f741d5 2023-11-02 21:55:21,540 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/cdfe737a2bc443609f91c25338f741d5, entries=1, sequenceid=37, filesize=5.0 K 2023-11-02 21:55:21,541 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78fa04c7b43844795d0ffcceeb0aa641 in 849ms, sequenceid=37, compaction requested=true 2023-11-02 21:55:21,541 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:21,541 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:21,541 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:21,542 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:21,542 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,542 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-02 21:55:21,542 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-02 21:55:21,592 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,592 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:21,592 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,592 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:21,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-02 21:55:21,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22e5b165[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:21,594 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-02 21:55:21,594 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,602 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,602 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,603 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:21,603 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-02 21:55:21,603 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-02 21:55:21,603 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:21,613 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-02 21:55:21,613 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,613 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:21,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,613 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-02 21:55:21,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:21,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:21,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:21,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:21,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-02 21:55:21,616 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-02 21:55:21,616 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:21,616 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:21,616 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,616 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:21,660 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,660 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:21,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,661 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:21,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:21,662 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:21,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,663 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:21,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,687 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,687 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:21,687 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:21,687 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:21,687 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:21,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:21,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:21,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:21,687 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,688 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,688 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,688 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,688 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:21,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:21,688 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:21,688 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:21,788 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:21,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:21,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:21,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:21,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,804 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:21,804 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:21,804 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-02 21:55:21,804 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-02 21:55:21,805 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,805 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,813 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,813 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:21,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:21,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:21,813 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:21,813 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:21,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:21,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,814 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,815 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-02 21:55:21,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:21,815 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-02 21:55:21,815 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:21,816 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-02 21:55:21,819 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:21,819 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:21,819 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:21,819 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. started... 2023-11-02 21:55:21,819 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 78fa04c7b43844795d0ffcceeb0aa641 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:21,855 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202a80e6afdf804ddda2f634341c4c1bf6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202a80e6afdf804ddda2f634341c4c1bf6 2023-11-02 21:55:22,270 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/7d71cc01345f4651b35d25be1eba8859 2023-11-02 21:55:22,278 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/7d71cc01345f4651b35d25be1eba8859 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/7d71cc01345f4651b35d25be1eba8859 2023-11-02 21:55:22,288 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/7d71cc01345f4651b35d25be1eba8859, entries=1, sequenceid=41, filesize=5.0 K 2023-11-02 21:55:22,289 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78fa04c7b43844795d0ffcceeb0aa641 in 470ms, sequenceid=41, compaction requested=true 2023-11-02 21:55:22,289 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:22,289 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:22,289 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:22,290 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:22,290 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,290 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-02 21:55:22,290 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-02 21:55:22,328 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,328 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:22,329 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,329 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:22,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:22,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-02 21:55:22,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ffcce29[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:22,331 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-02 21:55:22,331 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,396 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,396 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-02 21:55:22,396 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-02 21:55:22,396 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,397 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:22,396 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:22,487 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-02 21:55:22,487 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,488 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:22,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:22,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:22,488 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-02 21:55:22,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:22,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:22,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:22,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-02 21:55:22,499 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-02 21:55:22,499 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:22,499 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:22,500 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,500 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:22,574 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,574 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,574 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:22,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:22,576 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:22,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,579 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:22,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,646 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,646 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:22,646 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:22,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-02 21:55:22,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:22,646 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:22,646 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:22,646 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,647 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:22,647 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,647 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:22,647 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:22,647 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,647 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:22,747 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:22,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:22,756 DEBUG [Listener at localhost/34483] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-02 21:55:22,760 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:51902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-02 21:55:22,761 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:22,776 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-02 21:55:22,777 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-02 21:55:22,779 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:55:22,779 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962722779 2023-11-02 21:55:22,782 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:55:22,786 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-02 21:55:22,786 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-02 21:55:22,787 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x46f4dcbf to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:55:22,844 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@226105de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:55:22,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:23,333 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010363814e50f82d4368ad2695aeaed58be9 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010363814e50f82d4368ad2695aeaed58be9 2023-11-02 21:55:23,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-02 21:55:23,352 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:55:23,354 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:42712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:55:23,366 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:55:23,367 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:51912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:55:23,400 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/18f1897e2f714bcabcc11466f1e65267 first=Optional[r3] last=Optional[r6] 2023-11-02 21:55:23,411 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/18f1897e2f714bcabcc11466f1e65267}] 2023-11-02 21:55:23,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/18f1897e2f714bcabcc11466f1e65267 for inclusion in 78fa04c7b43844795d0ffcceeb0aa641/family1 2023-11-02 21:55:23,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-02 21:55:23,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:55:23,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:23,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/18f1897e2f714bcabcc11466f1e65267 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__lnc3lcqt4iha6uhk51a1ujffa56fjbhl79lh4icsd3i59pq4itblmmc1082dng6m/family1/18f1897e2f714bcabcc11466f1e65267 2023-11-02 21:55:23,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__lnc3lcqt4iha6uhk51a1ujffa56fjbhl79lh4icsd3i59pq4itblmmc1082dng6m/family1/18f1897e2f714bcabcc11466f1e65267 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/d86cf7275a5d475abb2aa5f26240ea39_SeqId_44_ 2023-11-02 21:55:23,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__lnc3lcqt4iha6uhk51a1ujffa56fjbhl79lh4icsd3i59pq4itblmmc1082dng6m/family1/18f1897e2f714bcabcc11466f1e65267 into 78fa04c7b43844795d0ffcceeb0aa641/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/d86cf7275a5d475abb2aa5f26240ea39_SeqId_44_ - updating store file list. 2023-11-02 21:55:23,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/d86cf7275a5d475abb2aa5f26240ea39_SeqId_44_ into 78fa04c7b43844795d0ffcceeb0aa641/family1 2023-11-02 21:55:23,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__lnc3lcqt4iha6uhk51a1ujffa56fjbhl79lh4icsd3i59pq4itblmmc1082dng6m/family1/18f1897e2f714bcabcc11466f1e65267 into 78fa04c7b43844795d0ffcceeb0aa641/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/d86cf7275a5d475abb2aa5f26240ea39_SeqId_44_) 2023-11-02 21:55:23,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__lnc3lcqt4iha6uhk51a1ujffa56fjbhl79lh4icsd3i59pq4itblmmc1082dng6m/family1/18f1897e2f714bcabcc11466f1e65267 2023-11-02 21:55:23,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-02 21:55:23,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-02 21:55:23,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 78fa04c7b43844795d0ffcceeb0aa641/family1 is initiating minor compaction 2023-11-02 21:55:23,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3b66bef8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:55:23,456 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 78fa04c7b43844795d0ffcceeb0aa641/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:23,456 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/6a374295223e4bb7bd022fc66b18224b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/2b55f3f9409746359b5a8bd804820dba, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/4e7c43b2a6bd47878fe481d22b79fde0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/731a435356de481e84b6986c467c2cd2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/35412b1868a140b3bbb4471b1b365d64, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/30f1f14e8d8b44a1a3662f217711638d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/abfe2291c68c4224b18ec9fdde191b13, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/cdfe737a2bc443609f91c25338f741d5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/7d71cc01345f4651b35d25be1eba8859, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/d86cf7275a5d475abb2aa5f26240ea39_SeqId_44_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp, totalSize=50.2 K 2023-11-02 21:55:23,457 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 6a374295223e4bb7bd022fc66b18224b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-02 21:55:23,457 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 2b55f3f9409746359b5a8bd804820dba, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-02 21:55:23,458 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 4e7c43b2a6bd47878fe481d22b79fde0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-02 21:55:23,458 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 731a435356de481e84b6986c467c2cd2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-02 21:55:23,458 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 35412b1868a140b3bbb4471b1b365d64, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-02 21:55:23,458 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 30f1f14e8d8b44a1a3662f217711638d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-02 21:55:23,458 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting abfe2291c68c4224b18ec9fdde191b13, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-02 21:55:23,458 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting cdfe737a2bc443609f91c25338f741d5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-02 21:55:23,458 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 7d71cc01345f4651b35d25be1eba8859, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-02 21:55:23,458 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting d86cf7275a5d475abb2aa5f26240ea39_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-02 21:55:23,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-02 21:55:23,473 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:23,478 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228799a84e2ad964b46820c86c69f79c0fe to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228799a84e2ad964b46820c86c69f79c0fe 2023-11-02 21:55:23,480 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123149990edf34b443ce8abafd9e075aa8dc to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123149990edf34b443ce8abafd9e075aa8dc 2023-11-02 21:55:23,482 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101823e42f598b44a50bca9eb97f8da9c3e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101823e42f598b44a50bca9eb97f8da9c3e 2023-11-02 21:55:23,483 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010310a0437d98784df39a1e014332c6bc72 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010310a0437d98784df39a1e014332c6bc72 2023-11-02 21:55:23,483 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-02 21:55:23,483 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-02 21:55:23,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:23,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:23,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:23,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:23,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:23,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:23,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:23,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:23,525 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 78fa04c7b43844795d0ffcceeb0aa641#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:55:23,562 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/96a710107d5d46caaea1964937bdaeb0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/96a710107d5d46caaea1964937bdaeb0 2023-11-02 21:55:23,588 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 78fa04c7b43844795d0ffcceeb0aa641/family1 of 78fa04c7b43844795d0ffcceeb0aa641 into 96a710107d5d46caaea1964937bdaeb0(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:55:23,588 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:23,592 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1698962123454; duration=0sec 2023-11-02 21:55:23,593 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:55:23,602 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fdc88db65f9743cbba18f7bbf671c2a2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205fdc88db65f9743cbba18f7bbf671c2a2 2023-11-02 21:55:23,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-02 21:55:23,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/6a374295223e4bb7bd022fc66b18224b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/2b55f3f9409746359b5a8bd804820dba, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/4e7c43b2a6bd47878fe481d22b79fde0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/731a435356de481e84b6986c467c2cd2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/35412b1868a140b3bbb4471b1b365d64, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/30f1f14e8d8b44a1a3662f217711638d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/abfe2291c68c4224b18ec9fdde191b13, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/cdfe737a2bc443609f91c25338f741d5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/7d71cc01345f4651b35d25be1eba8859, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/d86cf7275a5d475abb2aa5f26240ea39_SeqId_44_] to archive 2023-11-02 21:55:23,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:23,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/6a374295223e4bb7bd022fc66b18224b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/6a374295223e4bb7bd022fc66b18224b 2023-11-02 21:55:23,646 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/2b55f3f9409746359b5a8bd804820dba to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/2b55f3f9409746359b5a8bd804820dba 2023-11-02 21:55:23,649 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/4e7c43b2a6bd47878fe481d22b79fde0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/4e7c43b2a6bd47878fe481d22b79fde0 2023-11-02 21:55:23,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/731a435356de481e84b6986c467c2cd2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/731a435356de481e84b6986c467c2cd2 2023-11-02 21:55:23,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/35412b1868a140b3bbb4471b1b365d64 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/35412b1868a140b3bbb4471b1b365d64 2023-11-02 21:55:23,654 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8ff81294908e4eb691b5262c3eaf6578 first=Optional[r00] last=Optional[r2] 2023-11-02 21:55:23,655 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8ff81294908e4eb691b5262c3eaf6578}] 2023-11-02 21:55:23,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/30f1f14e8d8b44a1a3662f217711638d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/30f1f14e8d8b44a1a3662f217711638d 2023-11-02 21:55:23,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8ff81294908e4eb691b5262c3eaf6578 for inclusion in 78fa04c7b43844795d0ffcceeb0aa641/family1 2023-11-02 21:55:23,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/abfe2291c68c4224b18ec9fdde191b13 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/abfe2291c68c4224b18ec9fdde191b13 2023-11-02 21:55:23,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/cdfe737a2bc443609f91c25338f741d5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/cdfe737a2bc443609f91c25338f741d5 2023-11-02 21:55:23,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-02 21:55:23,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:55:23,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:23,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/7d71cc01345f4651b35d25be1eba8859 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/7d71cc01345f4651b35d25be1eba8859 2023-11-02 21:55:23,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8ff81294908e4eb691b5262c3eaf6578 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__seib8dc53deifv51gsrm3vp3088c3hl38na1ihueu86sc89f99r8het4tjpdvfpd/family1/8ff81294908e4eb691b5262c3eaf6578 2023-11-02 21:55:23,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/d86cf7275a5d475abb2aa5f26240ea39_SeqId_44_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/d86cf7275a5d475abb2aa5f26240ea39_SeqId_44_ 2023-11-02 21:55:23,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__seib8dc53deifv51gsrm3vp3088c3hl38na1ihueu86sc89f99r8het4tjpdvfpd/family1/8ff81294908e4eb691b5262c3eaf6578 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/0f168d4e15374600bb4af4c1594cb633_SeqId_47_ 2023-11-02 21:55:23,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__seib8dc53deifv51gsrm3vp3088c3hl38na1ihueu86sc89f99r8het4tjpdvfpd/family1/8ff81294908e4eb691b5262c3eaf6578 into 78fa04c7b43844795d0ffcceeb0aa641/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/0f168d4e15374600bb4af4c1594cb633_SeqId_47_ - updating store file list. 2023-11-02 21:55:23,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/0f168d4e15374600bb4af4c1594cb633_SeqId_47_ into 78fa04c7b43844795d0ffcceeb0aa641/family1 2023-11-02 21:55:23,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__seib8dc53deifv51gsrm3vp3088c3hl38na1ihueu86sc89f99r8het4tjpdvfpd/family1/8ff81294908e4eb691b5262c3eaf6578 into 78fa04c7b43844795d0ffcceeb0aa641/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/0f168d4e15374600bb4af4c1594cb633_SeqId_47_) 2023-11-02 21:55:23,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__seib8dc53deifv51gsrm3vp3088c3hl38na1ihueu86sc89f99r8het4tjpdvfpd/family1/8ff81294908e4eb691b5262c3eaf6578 2023-11-02 21:55:23,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-02 21:55:23,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-02 21:55:23,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 78fa04c7b43844795d0ffcceeb0aa641/family1 is initiating minor compaction (all files) 2023-11-02 21:55:23,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2c94a306; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-02 21:55:23,692 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 78fa04c7b43844795d0ffcceeb0aa641/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:23,692 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/a7074a23948c4d1496d0743468b54b93, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/96a710107d5d46caaea1964937bdaeb0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/0f168d4e15374600bb4af4c1594cb633_SeqId_47_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp, totalSize=358.6 K 2023-11-02 21:55:23,693 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting a7074a23948c4d1496d0743468b54b93, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878810443 2023-11-02 21:55:23,694 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 96a710107d5d46caaea1964937bdaeb0, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621210443 2023-11-02 21:55:23,695 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 0f168d4e15374600bb4af4c1594cb633_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878810443 2023-11-02 21:55:23,695 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-02 21:55:23,696 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:23,698 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130ef053d78f2fa41dd9b2cc4684096819c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130ef053d78f2fa41dd9b2cc4684096819c 2023-11-02 21:55:23,700 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120146c81331dba64413b9793edd18a9ce9a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120146c81331dba64413b9793edd18a9ce9a 2023-11-02 21:55:23,703 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a5db3a229ab24556b53cc077b9b2f143 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a5db3a229ab24556b53cc077b9b2f143 2023-11-02 21:55:23,703 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-02 21:55:23,703 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-02 21:55:23,704 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:23,704 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-02 21:55:23,704 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:55:23,705 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-02 21:55:23,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 938 msec 2023-11-02 21:55:23,743 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 78fa04c7b43844795d0ffcceeb0aa641#family1#compaction#11 average throughput is 5.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:55:23,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$12(2454): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-02 21:55:23,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:23,947 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-02 21:55:23,948 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-02 21:55:23,949 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-02 21:55:23,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-02 21:55:23,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78fa04c7b43844795d0ffcceeb0aa641, REOPEN/MOVE}] 2023-11-02 21:55:23,977 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78fa04c7b43844795d0ffcceeb0aa641, REOPEN/MOVE 2023-11-02 21:55:23,978 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=78fa04c7b43844795d0ffcceeb0aa641, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:23,979 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698962123978"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962123978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962123978"}]},"ts":"1698962123978"} 2023-11-02 21:55:23,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 78fa04c7b43844795d0ffcceeb0aa641, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:55:24,139 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:24,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(111): Close 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:24,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 78fa04c7b43844795d0ffcceeb0aa641, disabling compactions & flushes 2023-11-02 21:55:24,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:24,986 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/.tmp/family1/db4c7048263e4025890498c528d215c9 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/db4c7048263e4025890498c528d215c9 2023-11-02 21:55:24,994 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 78fa04c7b43844795d0ffcceeb0aa641/family1 of 78fa04c7b43844795d0ffcceeb0aa641 into db4c7048263e4025890498c528d215c9(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:55:24,994 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:24,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:24,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:24,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. after waiting 0 ms 2023-11-02 21:55:24,994 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1698962123692; duration=1sec 2023-11-02 21:55:24,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:24,994 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:55:24,998 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/a7074a23948c4d1496d0743468b54b93, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/96a710107d5d46caaea1964937bdaeb0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/0f168d4e15374600bb4af4c1594cb633_SeqId_47_] to archive 2023-11-02 21:55:24,999 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:25,001 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/a7074a23948c4d1496d0743468b54b93 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/a7074a23948c4d1496d0743468b54b93 2023-11-02 21:55:25,002 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/96a710107d5d46caaea1964937bdaeb0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/96a710107d5d46caaea1964937bdaeb0 2023-11-02 21:55:25,004 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/0f168d4e15374600bb4af4c1594cb633_SeqId_47_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/0f168d4e15374600bb4af4c1594cb633_SeqId_47_ 2023-11-02 21:55:25,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-02 21:55:25,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:25,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:25,011 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 78fa04c7b43844795d0ffcceeb0aa641 to self. 2023-11-02 21:55:25,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(149): Closed 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:25,014 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=78fa04c7b43844795d0ffcceeb0aa641, regionState=CLOSED 2023-11-02 21:55:25,014 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698962125014"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962125014"}]},"ts":"1698962125014"} 2023-11-02 21:55:25,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-02 21:55:25,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 78fa04c7b43844795d0ffcceeb0aa641, server=jenkins-hbase12.apache.org,33583,1698962105160 in 1.0350 sec 2023-11-02 21:55:25,019 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78fa04c7b43844795d0ffcceeb0aa641, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=true 2023-11-02 21:55:25,170 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=78fa04c7b43844795d0ffcceeb0aa641, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:25,170 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698962125170"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962125170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962125170"}]},"ts":"1698962125170"} 2023-11-02 21:55:25,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 78fa04c7b43844795d0ffcceeb0aa641, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:55:25,325 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:25,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:25,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 78fa04c7b43844795d0ffcceeb0aa641, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:55:25,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:25,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:25,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:25,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:25,330 INFO [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:25,332 DEBUG [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1 2023-11-02 21:55:25,332 DEBUG [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1 2023-11-02 21:55:25,332 INFO [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78fa04c7b43844795d0ffcceeb0aa641 columnFamilyName family1 2023-11-02 21:55:25,340 DEBUG [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/db4c7048263e4025890498c528d215c9 2023-11-02 21:55:25,340 INFO [StoreOpener-78fa04c7b43844795d0ffcceeb0aa641-1] regionserver.HStore(310): Store=78fa04c7b43844795d0ffcceeb0aa641/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:25,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:25,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:25,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:55:25,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 78fa04c7b43844795d0ffcceeb0aa641; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67849035, jitterRate=0.011029407382011414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:55:25,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:25,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641., pid=17, masterSystemTime=1698962125324 2023-11-02 21:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:25,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:55:25,350 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=78fa04c7b43844795d0ffcceeb0aa641, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:25,350 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698962125350"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962125350"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962125350"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962125350"}]},"ts":"1698962125350"} 2023-11-02 21:55:25,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-02 21:55:25,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 78fa04c7b43844795d0ffcceeb0aa641, server=jenkins-hbase12.apache.org,33583,1698962105160 in 179 msec 2023-11-02 21:55:25,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-02 21:55:25,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78fa04c7b43844795d0ffcceeb0aa641, REOPEN/MOVE in 1.3780 sec 2023-11-02 21:55:25,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-02 21:55:25,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4030 sec 2023-11-02 21:55:25,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4440 sec 2023-11-02 21:55:25,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-02 21:55:25,369 INFO [Listener at localhost/34483] compactions.TestMobCompactor(278): alter status finished 2023-11-02 21:55:25,371 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-02 21:55:25,372 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-02 21:55:25,373 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-02 21:55:25,374 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:55:25,374 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962725374 2023-11-02 21:55:25,375 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:55:25,376 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-02 21:55:25,376 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-02 21:55:25,378 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x56ed9fae to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:55:25,445 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68640f97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:55:25,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:25,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:25,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:25,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:25,446 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:25,884 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282f3b8871b97d4429a21f05c6a3672f2b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511282f3b8871b97d4429a21f05c6a3672f2b 2023-11-02 21:55:25,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-02 21:55:25,901 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:55:25,902 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:42720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:55:25,911 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:55:25,913 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:51922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:55:25,929 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/555fb6ee3d5c41fc99b1ef0e6dc8086d first=Optional[r05] last=Optional[r8] 2023-11-02 21:55:25,930 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=51 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/555fb6ee3d5c41fc99b1ef0e6dc8086d}] 2023-11-02 21:55:25,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/555fb6ee3d5c41fc99b1ef0e6dc8086d for inclusion in 78fa04c7b43844795d0ffcceeb0aa641/family1 2023-11-02 21:55:25,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-02 21:55:25,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:55:25,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:55:25,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/555fb6ee3d5c41fc99b1ef0e6dc8086d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vt3jd36g4tbq49g1143pfdt308av5e1q8hosk9m6nl480r14il0sbva3b8cigi81/family1/555fb6ee3d5c41fc99b1ef0e6dc8086d 2023-11-02 21:55:25,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vt3jd36g4tbq49g1143pfdt308av5e1q8hosk9m6nl480r14il0sbva3b8cigi81/family1/555fb6ee3d5c41fc99b1ef0e6dc8086d as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/20116b76ae874b979de465b4768795ee_SeqId_53_ 2023-11-02 21:55:25,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vt3jd36g4tbq49g1143pfdt308av5e1q8hosk9m6nl480r14il0sbva3b8cigi81/family1/555fb6ee3d5c41fc99b1ef0e6dc8086d into 78fa04c7b43844795d0ffcceeb0aa641/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/20116b76ae874b979de465b4768795ee_SeqId_53_ - updating store file list. 2023-11-02 21:55:25,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/20116b76ae874b979de465b4768795ee_SeqId_53_ into 78fa04c7b43844795d0ffcceeb0aa641/family1 2023-11-02 21:55:25,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vt3jd36g4tbq49g1143pfdt308av5e1q8hosk9m6nl480r14il0sbva3b8cigi81/family1/555fb6ee3d5c41fc99b1ef0e6dc8086d into 78fa04c7b43844795d0ffcceeb0aa641/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/family1/20116b76ae874b979de465b4768795ee_SeqId_53_) 2023-11-02 21:55:25,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vt3jd36g4tbq49g1143pfdt308av5e1q8hosk9m6nl480r14il0sbva3b8cigi81/family1/555fb6ee3d5c41fc99b1ef0e6dc8086d 2023-11-02 21:55:25,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-02 21:55:25,957 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:25,959 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202a80e6afdf804ddda2f634341c4c1bf6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202a80e6afdf804ddda2f634341c4c1bf6 2023-11-02 21:55:25,961 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285de41ac38c9e4c3081baf457cb7bc798 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285de41ac38c9e4c3081baf457cb7bc798 2023-11-02 21:55:25,961 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-02 21:55:25,961 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-02 21:55:25,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:25,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:25,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-02 21:55:25,961 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-02 21:55:25,962 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:55:25,963 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-02 21:55:25,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 592 msec 2023-11-02 21:55:26,064 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=253 (was 214) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54382 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9dc6e4b-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49550@0x46f4dcbf sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/677244075.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase12:33583-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1993670402_17 at /127.0.0.1:54178 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54346 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54276 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54200 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54322 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54214 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5581d015-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5581d015-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54138 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5581d015-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9dc6e4b-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54160 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54222 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54248 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9dc6e4b-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54192 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49550@0x56ed9fae-SendThread(127.0.0.1:49550) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9dc6e4b-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49550@0x56ed9fae sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/677244075.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x9dc6e4b-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54246 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54078 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49550@0x46f4dcbf-SendThread(127.0.0.1:49550) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54264 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:54106 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49550@0x46f4dcbf-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49550@0x56ed9fae-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) - Thread LEAK? -, OpenFileDescriptor=623 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=299 (was 256) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=1184 (was 1403) 2023-11-02 21:55:26,077 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=253, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=299, ProcessCount=174, AvailableMemoryMB=1182 2023-11-02 21:55:26,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-02 21:55:26,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:26,083 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:55:26,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-02 21:55:26,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:55:26,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-02 21:55:26,086 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1 2023-11-02 21:55:26,086 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1 empty. 2023-11-02 21:55:26,087 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1 2023-11-02 21:55:26,087 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-02 21:55:26,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-02 21:55:26,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-02 21:55:26,499 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-02 21:55:26,501 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8e9e4ab39f8ae69643af213a16c22de1, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:55:26,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-02 21:55:26,907 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:26,907 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 8e9e4ab39f8ae69643af213a16c22de1, disabling compactions & flushes 2023-11-02 21:55:26,907 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:26,907 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:26,907 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. after waiting 0 ms 2023-11-02 21:55:26,907 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:26,907 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:26,907 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:26,910 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:55:26,912 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698962126912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962126912"}]},"ts":"1698962126912"} 2023-11-02 21:55:26,913 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-02 21:55:26,915 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:55:26,915 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962126915"}]},"ts":"1698962126915"} 2023-11-02 21:55:26,916 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-02 21:55:26,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8e9e4ab39f8ae69643af213a16c22de1, ASSIGN}] 2023-11-02 21:55:26,983 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8e9e4ab39f8ae69643af213a16c22de1, ASSIGN 2023-11-02 21:55:26,984 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8e9e4ab39f8ae69643af213a16c22de1, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:55:27,135 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8e9e4ab39f8ae69643af213a16c22de1, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:27,136 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698962127135"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962127135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962127135"}]},"ts":"1698962127135"} 2023-11-02 21:55:27,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 8e9e4ab39f8ae69643af213a16c22de1, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:55:27,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-02 21:55:27,290 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:27,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:27,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8e9e4ab39f8ae69643af213a16c22de1, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:55:27,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 8e9e4ab39f8ae69643af213a16c22de1 2023-11-02 21:55:27,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:27,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 8e9e4ab39f8ae69643af213a16c22de1 2023-11-02 21:55:27,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 8e9e4ab39f8ae69643af213a16c22de1 2023-11-02 21:55:27,306 INFO [StoreOpener-8e9e4ab39f8ae69643af213a16c22de1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8e9e4ab39f8ae69643af213a16c22de1 2023-11-02 21:55:27,308 DEBUG [StoreOpener-8e9e4ab39f8ae69643af213a16c22de1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1 2023-11-02 21:55:27,308 DEBUG [StoreOpener-8e9e4ab39f8ae69643af213a16c22de1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1 2023-11-02 21:55:27,309 INFO [StoreOpener-8e9e4ab39f8ae69643af213a16c22de1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e9e4ab39f8ae69643af213a16c22de1 columnFamilyName family1 2023-11-02 21:55:27,311 INFO [StoreOpener-8e9e4ab39f8ae69643af213a16c22de1-1] regionserver.HStore(310): Store=8e9e4ab39f8ae69643af213a16c22de1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:27,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1 2023-11-02 21:55:27,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1 2023-11-02 21:55:27,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 8e9e4ab39f8ae69643af213a16c22de1 2023-11-02 21:55:27,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:55:27,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 8e9e4ab39f8ae69643af213a16c22de1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63056242, jitterRate=-0.060388773679733276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:55:27,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:27,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1., pid=21, masterSystemTime=1698962127290 2023-11-02 21:55:27,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:27,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:27,323 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8e9e4ab39f8ae69643af213a16c22de1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:27,323 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698962127323"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962127323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962127323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962127323"}]},"ts":"1698962127323"} 2023-11-02 21:55:27,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-02 21:55:27,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 8e9e4ab39f8ae69643af213a16c22de1, server=jenkins-hbase12.apache.org,33583,1698962105160 in 187 msec 2023-11-02 21:55:27,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-02 21:55:27,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8e9e4ab39f8ae69643af213a16c22de1, ASSIGN in 347 msec 2023-11-02 21:55:27,332 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:55:27,332 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962127332"}]},"ts":"1698962127332"} 2023-11-02 21:55:27,336 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-02 21:55:27,351 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:55:27,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2710 sec 2023-11-02 21:55:28,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-02 21:55:28,192 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-02 21:55:28,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:28,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:28,232 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:28,232 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:28,232 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:55:28,232 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:28,233 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:28,233 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:28,255 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:28,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:28,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:28,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:28,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:28,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:28,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:28,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:28,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:28,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:28,257 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:55:28,257 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:28,257 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:55:28,257 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:28,258 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:28,258 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:28,258 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. started... 2023-11-02 21:55:28,258 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8e9e4ab39f8ae69643af213a16c22de1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-02 21:55:28,701 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130cc80234d64cd4618a81f7379f623aefe to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130cc80234d64cd4618a81f7379f623aefe 2023-11-02 21:55:29,106 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/cc77e6a13a164d62b841538a7b526f26 2023-11-02 21:55:29,114 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/cc77e6a13a164d62b841538a7b526f26 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/cc77e6a13a164d62b841538a7b526f26 2023-11-02 21:55:29,122 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/cc77e6a13a164d62b841538a7b526f26, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-02 21:55:29,123 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8e9e4ab39f8ae69643af213a16c22de1 in 865ms, sequenceid=5, compaction requested=false 2023-11-02 21:55:29,123 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:29,125 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:29,125 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:29,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:29,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:29,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:55:29,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:55:29,134 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,134 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:29,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:29,134 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,134 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:29,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:29,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:29,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:29,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:55:29,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bf537a2[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:29,136 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:29,136 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,145 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,145 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:29,145 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:55:29,145 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:29,145 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,145 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:29,155 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:55:29,155 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:29,155 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:55:29,155 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:29,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:29,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:29,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:29,160 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:55:29,160 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:29,160 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:29,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:29,160 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,160 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:29,170 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,170 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:29,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:29,170 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:29,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:29,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:29,171 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:29,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,174 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:29,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,265 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,265 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:29,265 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,265 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:29,265 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:29,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:29,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:29,266 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,265 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:29,266 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,266 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:29,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:29,267 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:29,266 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,268 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:29,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:29,368 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:29,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:29,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:29,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:29,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,378 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:29,378 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:29,379 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:55:29,379 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:29,380 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,380 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,402 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:29,402 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:29,402 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,402 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,403 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:55:29,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,404 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:55:29,404 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:29,404 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:55:29,404 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:29,404 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:29,404 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:29,404 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. started... 2023-11-02 21:55:29,404 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8e9e4ab39f8ae69643af213a16c22de1 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-02 21:55:29,819 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281609b9e1d0bd4a249e93b8fe20679503 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511281609b9e1d0bd4a249e93b8fe20679503 2023-11-02 21:55:29,828 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/2b63045dcb65441ebf39d09c4962f631 2023-11-02 21:55:29,836 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/2b63045dcb65441ebf39d09c4962f631 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2b63045dcb65441ebf39d09c4962f631 2023-11-02 21:55:29,844 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2b63045dcb65441ebf39d09c4962f631, entries=1, sequenceid=9, filesize=5.0 K 2023-11-02 21:55:29,845 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8e9e4ab39f8ae69643af213a16c22de1 in 441ms, sequenceid=9, compaction requested=false 2023-11-02 21:55:29,845 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:29,845 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:29,845 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:29,845 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:29,845 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,845 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:55:29,845 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:55:29,860 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,860 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:29,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:29,861 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,861 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:29,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:29,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:29,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:29,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:55:29,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b831411[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:29,862 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:29,862 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,949 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,950 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:29,950 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:55:29,950 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:29,950 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,950 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:29,960 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:55:29,960 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,960 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:29,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:29,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:29,960 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:55:29,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:29,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:29,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:29,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:29,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:29,964 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:55:29,964 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:29,964 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:29,964 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,965 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:29,976 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,976 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,976 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:29,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:29,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:29,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:29,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:29,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:29,977 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:29,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,979 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,991 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,991 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:29,991 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:29,991 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:29,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:55:29,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:29,992 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:29,992 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:29,992 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:29,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:29,992 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,993 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:29,993 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,993 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:29,993 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:29,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:29,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:30,094 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:30,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:30,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:30,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:30,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:30,103 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:30,103 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:30,103 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:55:30,104 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:30,104 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:30,104 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:30,113 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:30,113 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:30,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:30,114 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:30,114 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:30,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:30,115 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:30,115 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:55:30,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:30,115 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:55:30,115 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:30,116 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:55:30,116 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:30,116 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:30,116 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:30,116 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. started... 2023-11-02 21:55:30,117 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8e9e4ab39f8ae69643af213a16c22de1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:30,535 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010abbcca53cd747eaa6e1c38d954b7d55 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512010abbcca53cd747eaa6e1c38d954b7d55 2023-11-02 21:55:30,545 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:55:30,941 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/ecd4b0a15b294f73b337dde1a37e6306 2023-11-02 21:55:30,949 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/ecd4b0a15b294f73b337dde1a37e6306 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ecd4b0a15b294f73b337dde1a37e6306 2023-11-02 21:55:30,958 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ecd4b0a15b294f73b337dde1a37e6306, entries=1, sequenceid=13, filesize=4.9 K 2023-11-02 21:55:30,959 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e9e4ab39f8ae69643af213a16c22de1 in 842ms, sequenceid=13, compaction requested=true 2023-11-02 21:55:30,959 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:30,959 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:30,959 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:30,959 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:30,959 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:30,959 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:55:30,959 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:55:31,033 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,033 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:31,034 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,034 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:31,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:55:31,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2462f69d[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:31,036 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:31,036 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,054 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,055 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:31,055 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:55:31,055 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:31,055 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,055 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:31,075 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:55:31,075 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,075 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:31,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,076 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:55:31,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:31,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:31,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:31,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:31,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:31,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:31,079 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:55:31,079 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:31,079 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:31,079 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,079 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:31,092 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,092 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:31,092 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:31,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:31,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:31,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:31,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:31,094 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:31,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,096 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:31,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,107 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,107 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,107 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,107 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,107 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,107 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,107 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,107 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:31,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:31,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:31,107 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:31,112 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:31,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:31,112 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:31,112 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:31,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:31,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:31,213 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:31,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:31,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:31,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:31,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,222 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:31,222 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:31,223 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:55:31,223 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:31,224 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,224 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,233 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:31,233 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:31,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:31,234 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,234 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,235 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,235 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:55:31,235 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,235 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:55:31,235 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:31,236 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:55:31,236 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:31,236 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:31,236 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:31,236 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. started... 2023-11-02 21:55:31,236 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8e9e4ab39f8ae69643af213a16c22de1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:31,257 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a8411fb9acfc4a01863b1f537a9ff514 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a8411fb9acfc4a01863b1f537a9ff514 2023-11-02 21:55:31,666 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/4146768ac9784e71bbac97d7fc5f26bb 2023-11-02 21:55:31,679 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/4146768ac9784e71bbac97d7fc5f26bb as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/4146768ac9784e71bbac97d7fc5f26bb 2023-11-02 21:55:31,691 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/4146768ac9784e71bbac97d7fc5f26bb, entries=1, sequenceid=17, filesize=4.9 K 2023-11-02 21:55:31,692 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e9e4ab39f8ae69643af213a16c22de1 in 456ms, sequenceid=17, compaction requested=true 2023-11-02 21:55:31,693 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:31,693 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:31,693 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:31,693 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:31,693 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,693 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:55:31,693 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:55:31,781 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,781 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:31,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:31,782 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:31,782 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:31,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:55:31,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d56f9be[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:31,783 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:31,784 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,791 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,791 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:31,791 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,791 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:31,791 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:55:31,792 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:31,828 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:55:31,828 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,828 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:31,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:31,828 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:55:31,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:31,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:31,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:31,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:31,834 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:55:31,834 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:31,834 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:31,834 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,834 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:31,854 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,854 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,854 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:31,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:31,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:31,855 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:31,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:31,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:31,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:31,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,856 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:31,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,865 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,865 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:31,865 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:31,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:31,865 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,865 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:31,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:31,865 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:31,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:55:31,865 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:31,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:31,865 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:31,866 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:31,866 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,866 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:31,866 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,966 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:31,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:31,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:31,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:31,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,980 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:31,980 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:31,980 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:55:31,980 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:31,981 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,981 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,991 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:31,991 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:31,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:31,992 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:31,992 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:31,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:31,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,992 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,993 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:55:31,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:31,993 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:55:31,993 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:31,993 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:55:31,993 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:31,993 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:31,993 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:31,994 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. started... 2023-11-02 21:55:31,994 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8e9e4ab39f8ae69643af213a16c22de1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:32,415 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228afd14a43fd3a4e8188481aa7cf56fe65 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228afd14a43fd3a4e8188481aa7cf56fe65 2023-11-02 21:55:32,825 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/2f99425dab984026abfc8c76741e0ffd 2023-11-02 21:55:32,832 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/2f99425dab984026abfc8c76741e0ffd as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2f99425dab984026abfc8c76741e0ffd 2023-11-02 21:55:32,839 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2f99425dab984026abfc8c76741e0ffd, entries=1, sequenceid=21, filesize=4.9 K 2023-11-02 21:55:32,840 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e9e4ab39f8ae69643af213a16c22de1 in 846ms, sequenceid=21, compaction requested=true 2023-11-02 21:55:32,841 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:32,841 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:32,841 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:32,841 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:32,841 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,841 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:55:32,841 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:55:32,928 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,928 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:32,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:32,928 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,929 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:32,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:55:32,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f1c8591[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:32,930 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:32,930 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,938 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,939 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,939 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:32,939 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:32,939 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:55:32,939 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:32,949 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:55:32,949 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,949 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:32,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:32,949 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:55:32,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:32,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:32,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:32,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:32,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:32,954 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:55:32,954 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:32,954 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:32,954 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,954 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:32,966 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,966 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:32,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,970 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:32,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:32,971 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:32,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,972 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,981 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:32,981 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:32,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:32,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:32,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:32,983 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,983 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,983 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,983 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:32,983 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,983 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,983 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:32,983 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:32,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:32,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:32,984 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:32,984 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:33,085 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:33,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:33,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:33,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:33,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:33,096 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:33,096 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:33,097 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:55:33,097 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:33,097 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:33,097 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:33,107 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:33,107 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:33,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:33,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:33,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:33,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:33,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:33,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:33,109 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:33,109 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:55:33,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:33,109 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:55:33,109 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:33,110 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:55:33,112 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:33,112 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:33,112 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:33,112 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:33,112 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:33,112 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. started... 2023-11-02 21:55:33,112 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8e9e4ab39f8ae69643af213a16c22de1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:33,549 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317e1385bea6e44e80995cb1440307bbe3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317e1385bea6e44e80995cb1440307bbe3 2023-11-02 21:55:33,956 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/31ac008c28334bacb16adb14f4cf4a02 2023-11-02 21:55:33,964 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/31ac008c28334bacb16adb14f4cf4a02 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/31ac008c28334bacb16adb14f4cf4a02 2023-11-02 21:55:33,970 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/31ac008c28334bacb16adb14f4cf4a02, entries=1, sequenceid=25, filesize=4.9 K 2023-11-02 21:55:33,971 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e9e4ab39f8ae69643af213a16c22de1 in 859ms, sequenceid=25, compaction requested=true 2023-11-02 21:55:33,971 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:33,971 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:33,971 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:33,971 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:33,971 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:33,971 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:55:33,971 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:55:34,022 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,022 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:34,023 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,023 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:34,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:34,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:34,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:55:34,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c8c29ff[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:34,025 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:34,025 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,033 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,033 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:34,033 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:55:34,033 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:34,033 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,033 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:34,043 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:55:34,044 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,044 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:34,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:34,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:34,044 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:55:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:34,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:34,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:34,048 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:55:34,048 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:34,048 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:34,048 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,048 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:34,060 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,060 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:34,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:34,060 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:34,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:34,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:34,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:34,061 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:34,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,062 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:34,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,075 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,075 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:34,075 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:34,075 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:34,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:34,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:34,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:34,075 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,075 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:34,076 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,076 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,076 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,076 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:34,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:34,077 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:34,076 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:34,177 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:34,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:34,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:34,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:34,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,185 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:34,185 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:34,186 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:55:34,186 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:34,186 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,187 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,197 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:34,197 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:34,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:34,198 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:34,198 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:34,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:34,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,199 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,199 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:55:34,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:34,199 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:55:34,199 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:34,199 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:55:34,199 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:34,200 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:34,200 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:34,200 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. started... 2023-11-02 21:55:34,200 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8e9e4ab39f8ae69643af213a16c22de1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:34,619 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e2210d4f555b4f41bc3da2192f761543 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e2210d4f555b4f41bc3da2192f761543 2023-11-02 21:55:35,027 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/6a091cfa2c8149b7877ecd83dbd2ca42 2023-11-02 21:55:35,040 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/6a091cfa2c8149b7877ecd83dbd2ca42 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/6a091cfa2c8149b7877ecd83dbd2ca42 2023-11-02 21:55:35,047 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/6a091cfa2c8149b7877ecd83dbd2ca42, entries=1, sequenceid=29, filesize=4.9 K 2023-11-02 21:55:35,049 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e9e4ab39f8ae69643af213a16c22de1 in 849ms, sequenceid=29, compaction requested=true 2023-11-02 21:55:35,049 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:35,049 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:35,049 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:35,049 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:35,049 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,049 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:55:35,049 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:55:35,125 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:35,127 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,127 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:35,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:35,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:35,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:35,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:55:35,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f69e4ed[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:35,132 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:35,133 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,155 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,155 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:35,155 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:55:35,155 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:35,156 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,156 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:35,165 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:55:35,165 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:35,165 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:55:35,165 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:35,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:35,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:35,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:35,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:35,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:35,173 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:55:35,173 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:35,173 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:35,173 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,173 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:35,187 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,187 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:35,187 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:35,189 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,192 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:35,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,201 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,201 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:35,201 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:35,201 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:35,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:55:35,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:35,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:35,201 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:35,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:35,201 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,203 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:35,203 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:35,203 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,203 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,203 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,203 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,303 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:35,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:35,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:35,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:35,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,314 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:35,315 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:35,315 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:55:35,315 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:35,316 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,316 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,328 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,328 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:35,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:35,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:35,328 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:35,328 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:35,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:35,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,329 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,329 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:55:35,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:35,329 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:55:35,329 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:35,330 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:55:35,330 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:35,330 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:35,330 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:35,330 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. started... 2023-11-02 21:55:35,330 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8e9e4ab39f8ae69643af213a16c22de1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:35,750 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ba4c2eade14e492c9da02855ed283205 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103ba4c2eade14e492c9da02855ed283205 2023-11-02 21:55:36,158 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/25334d68f3dc4d2eb7f81d363f9ab922 2023-11-02 21:55:36,169 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/25334d68f3dc4d2eb7f81d363f9ab922 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/25334d68f3dc4d2eb7f81d363f9ab922 2023-11-02 21:55:36,177 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/25334d68f3dc4d2eb7f81d363f9ab922, entries=1, sequenceid=33, filesize=4.9 K 2023-11-02 21:55:36,178 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e9e4ab39f8ae69643af213a16c22de1 in 848ms, sequenceid=33, compaction requested=true 2023-11-02 21:55:36,178 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:36,178 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:36,178 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:36,178 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:36,178 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,179 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:55:36,179 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:55:36,254 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,254 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:36,255 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,255 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:36,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:36,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:55:36,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35d875b7[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:36,258 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:36,258 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,270 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,271 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:36,271 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:55:36,271 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:36,271 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,271 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:36,281 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:55:36,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,281 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:36,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:36,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:36,281 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:55:36,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:36,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:36,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:36,286 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:55:36,286 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:36,286 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:36,287 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,287 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:36,296 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,296 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,296 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:36,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:36,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:36,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:36,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:36,298 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:36,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:36,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,300 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,312 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,313 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:36,313 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,313 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:36,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:55:36,313 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:36,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:36,313 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:36,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:36,313 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:36,313 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,314 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:36,314 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,314 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:36,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:36,314 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:36,414 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:36,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:36,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:36,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:36,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,429 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:36,430 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:36,430 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:55:36,430 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:36,431 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,431 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,444 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,444 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:36,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:36,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:36,445 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,445 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:36,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:36,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,448 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,448 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:55:36,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,449 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:55:36,449 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:36,450 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:55:36,450 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:36,450 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:36,450 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:36,450 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. started... 2023-11-02 21:55:36,451 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8e9e4ab39f8ae69643af213a16c22de1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:36,470 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090728e242df546042738da7535313415e19 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090728e242df546042738da7535313415e19 2023-11-02 21:55:36,877 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/aaeab6a2cf0c4bc2848cb11fa45ccfa5 2023-11-02 21:55:36,887 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/aaeab6a2cf0c4bc2848cb11fa45ccfa5 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/aaeab6a2cf0c4bc2848cb11fa45ccfa5 2023-11-02 21:55:36,893 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/aaeab6a2cf0c4bc2848cb11fa45ccfa5, entries=1, sequenceid=37, filesize=4.9 K 2023-11-02 21:55:36,895 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e9e4ab39f8ae69643af213a16c22de1 in 444ms, sequenceid=37, compaction requested=true 2023-11-02 21:55:36,895 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:36,895 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:36,895 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:36,895 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:36,895 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,895 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:55:36,895 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:55:36,949 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,949 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:36,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:36,950 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:36,950 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:36,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:36,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:36,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:55:36,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e934e90[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:36,954 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:36,955 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,965 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,965 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:36,966 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:55:36,966 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:36,966 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,966 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:36,976 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:55:36,976 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,976 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:36,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:36,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:36,976 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:55:36,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:36,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:36,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:36,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:36,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:36,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:36,983 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:55:36,984 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:36,984 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:36,984 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,984 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:36,997 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,997 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:36,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:36,997 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:36,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:36,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:36,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:36,999 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,002 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:37,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:37,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:37,042 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:37,042 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:37,042 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,042 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:37,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:55:37,042 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:37,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:37,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:37,042 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:37,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:37,044 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,044 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:37,044 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:37,044 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,044 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:37,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:37,144 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:37,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:37,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:37,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:37,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,160 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:37,161 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:37,161 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:55:37,161 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:37,162 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,162 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,180 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:37,181 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:37,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:37,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:37,182 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:37,182 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:37,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:37,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,185 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,186 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:55:37,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:37,186 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:55:37,186 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:37,189 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:55:37,189 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:37,189 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:37,189 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:37,189 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. started... 2023-11-02 21:55:37,190 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8e9e4ab39f8ae69643af213a16c22de1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:37,611 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f27b2acaa56c4917a6d63c4a23735ca8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120f27b2acaa56c4917a6d63c4a23735ca8 2023-11-02 21:55:38,018 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/47a9dbc58d874adaa6eea41fd3bf53f9 2023-11-02 21:55:38,031 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/47a9dbc58d874adaa6eea41fd3bf53f9 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/47a9dbc58d874adaa6eea41fd3bf53f9 2023-11-02 21:55:38,038 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/47a9dbc58d874adaa6eea41fd3bf53f9, entries=1, sequenceid=41, filesize=4.9 K 2023-11-02 21:55:38,040 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e9e4ab39f8ae69643af213a16c22de1 in 850ms, sequenceid=41, compaction requested=true 2023-11-02 21:55:38,040 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:38,040 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:38,040 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:38,040 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:38,040 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,040 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:55:38,040 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:55:38,085 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,086 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:38,086 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,086 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:38,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:38,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:38,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:55:38,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31d556c[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:38,090 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:38,090 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,102 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,102 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:38,102 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:55:38,102 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:38,102 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,102 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:38,113 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,113 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:55:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:38,113 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:38,113 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:55:38,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:38,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:38,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:38,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:38,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:38,118 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:55:38,118 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:38,118 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:38,118 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,118 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:38,127 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,127 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,128 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:38,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:38,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:38,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:38,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:38,129 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:38,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:38,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,131 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,144 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,145 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,145 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:38,145 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,145 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:38,145 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:38,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:38,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-02 21:55:38,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:38,145 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:38,145 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:38,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:55:38,148 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:38,149 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:38,148 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,149 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:38,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:38,249 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:38,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:38,252 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-02 21:55:38,253 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:55:38,254 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:55:38,255 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:55:38,255 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962738255 2023-11-02 21:55:38,256 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:55:38,257 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-02 21:55:38,258 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:55:38,259 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x1b1e1462 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:55:38,271 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53cea821, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:55:38,271 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:55:39,117 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ccb19259ce7b45e392f36245af497a93 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103ccb19259ce7b45e392f36245af497a93 2023-11-02 21:55:39,119 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:55:39,132 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:55:39,133 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:54830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:55:39,139 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:55:39,140 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:37012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:55:39,152 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/998cd6c483f348c5b0985ada1b7c1eec first=Optional[r5] last=Optional[r6] 2023-11-02 21:55:39,153 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/998cd6c483f348c5b0985ada1b7c1eec}] 2023-11-02 21:55:39,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/998cd6c483f348c5b0985ada1b7c1eec for inclusion in 8e9e4ab39f8ae69643af213a16c22de1/family1 2023-11-02 21:55:39,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-02 21:55:39,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:55:39,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:39,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/998cd6c483f348c5b0985ada1b7c1eec to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ogb8kfbket4mlmknduihn7tprlg08bsn1oorl1v2bemoa17t717ppv3sau1um08v/family1/998cd6c483f348c5b0985ada1b7c1eec 2023-11-02 21:55:39,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ogb8kfbket4mlmknduihn7tprlg08bsn1oorl1v2bemoa17t717ppv3sau1um08v/family1/998cd6c483f348c5b0985ada1b7c1eec as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ce88923f294f4f279ea5da27e62eddc4_SeqId_44_ 2023-11-02 21:55:39,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ogb8kfbket4mlmknduihn7tprlg08bsn1oorl1v2bemoa17t717ppv3sau1um08v/family1/998cd6c483f348c5b0985ada1b7c1eec into 8e9e4ab39f8ae69643af213a16c22de1/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ce88923f294f4f279ea5da27e62eddc4_SeqId_44_ - updating store file list. 2023-11-02 21:55:39,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ce88923f294f4f279ea5da27e62eddc4_SeqId_44_ into 8e9e4ab39f8ae69643af213a16c22de1/family1 2023-11-02 21:55:39,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ogb8kfbket4mlmknduihn7tprlg08bsn1oorl1v2bemoa17t717ppv3sau1um08v/family1/998cd6c483f348c5b0985ada1b7c1eec into 8e9e4ab39f8ae69643af213a16c22de1/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ce88923f294f4f279ea5da27e62eddc4_SeqId_44_) 2023-11-02 21:55:39,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ogb8kfbket4mlmknduihn7tprlg08bsn1oorl1v2bemoa17t717ppv3sau1um08v/family1/998cd6c483f348c5b0985ada1b7c1eec 2023-11-02 21:55:39,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-02 21:55:39,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-02 21:55:39,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 8e9e4ab39f8ae69643af213a16c22de1/family1 is initiating minor compaction 2023-11-02 21:55:39,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7cc44301; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-02 21:55:39,182 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8e9e4ab39f8ae69643af213a16c22de1/family1 in testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:39,182 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2b63045dcb65441ebf39d09c4962f631, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ecd4b0a15b294f73b337dde1a37e6306, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/4146768ac9784e71bbac97d7fc5f26bb, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2f99425dab984026abfc8c76741e0ffd, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/31ac008c28334bacb16adb14f4cf4a02, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/6a091cfa2c8149b7877ecd83dbd2ca42, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/25334d68f3dc4d2eb7f81d363f9ab922, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/aaeab6a2cf0c4bc2848cb11fa45ccfa5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/47a9dbc58d874adaa6eea41fd3bf53f9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ce88923f294f4f279ea5da27e62eddc4_SeqId_44_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp, totalSize=49.7 K 2023-11-02 21:55:39,182 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 2b63045dcb65441ebf39d09c4962f631, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-02 21:55:39,182 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting ecd4b0a15b294f73b337dde1a37e6306, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-02 21:55:39,182 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 4146768ac9784e71bbac97d7fc5f26bb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-02 21:55:39,183 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 2f99425dab984026abfc8c76741e0ffd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-02 21:55:39,183 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 31ac008c28334bacb16adb14f4cf4a02, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-02 21:55:39,183 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 6a091cfa2c8149b7877ecd83dbd2ca42, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-02 21:55:39,183 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 25334d68f3dc4d2eb7f81d363f9ab922, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-02 21:55:39,183 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting aaeab6a2cf0c4bc2848cb11fa45ccfa5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-02 21:55:39,183 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 47a9dbc58d874adaa6eea41fd3bf53f9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-02 21:55:39,183 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting ce88923f294f4f279ea5da27e62eddc4_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-02 21:55:39,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:55:39,186 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:39,187 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e2210d4f555b4f41bc3da2192f761543 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e2210d4f555b4f41bc3da2192f761543 2023-11-02 21:55:39,189 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103ba4c2eade14e492c9da02855ed283205 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103ba4c2eade14e492c9da02855ed283205 2023-11-02 21:55:39,189 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-02 21:55:39,189 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-02 21:55:39,190 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:55:39,190 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:55:39,230 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8e9e4ab39f8ae69643af213a16c22de1#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:55:40,059 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/a521c0f7a3b74947bc4758632fec3a7f as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/a521c0f7a3b74947bc4758632fec3a7f 2023-11-02 21:55:40,065 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fcdfca3fca7f4be7b63c22e25c343d5a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231fcdfca3fca7f4be7b63c22e25c343d5a 2023-11-02 21:55:40,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:55:40,070 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8e9e4ab39f8ae69643af213a16c22de1/family1 of 8e9e4ab39f8ae69643af213a16c22de1 into a521c0f7a3b74947bc4758632fec3a7f(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:55:40,070 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:40,070 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698962139182; duration=0sec 2023-11-02 21:55:40,071 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:55:40,091 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/47d5625cc7f243eab0ab72ea1912e29f first=Optional[r1] last=Optional[r4] 2023-11-02 21:55:40,092 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/47d5625cc7f243eab0ab72ea1912e29f}] 2023-11-02 21:55:40,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/47d5625cc7f243eab0ab72ea1912e29f for inclusion in 8e9e4ab39f8ae69643af213a16c22de1/family1 2023-11-02 21:55:40,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-02 21:55:40,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:55:40,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:40,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/47d5625cc7f243eab0ab72ea1912e29f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__e7h3enu2d2nqt8ceh8kf8qvbargpfh2ghbv4gnogkeeid8ihot8ih756a1amghon/family1/47d5625cc7f243eab0ab72ea1912e29f 2023-11-02 21:55:40,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__e7h3enu2d2nqt8ceh8kf8qvbargpfh2ghbv4gnogkeeid8ihot8ih756a1amghon/family1/47d5625cc7f243eab0ab72ea1912e29f as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/9c1c7340b2bf48ba8813031063a2a962_SeqId_47_ 2023-11-02 21:55:40,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__e7h3enu2d2nqt8ceh8kf8qvbargpfh2ghbv4gnogkeeid8ihot8ih756a1amghon/family1/47d5625cc7f243eab0ab72ea1912e29f into 8e9e4ab39f8ae69643af213a16c22de1/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/9c1c7340b2bf48ba8813031063a2a962_SeqId_47_ - updating store file list. 2023-11-02 21:55:40,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/9c1c7340b2bf48ba8813031063a2a962_SeqId_47_ into 8e9e4ab39f8ae69643af213a16c22de1/family1 2023-11-02 21:55:40,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__e7h3enu2d2nqt8ceh8kf8qvbargpfh2ghbv4gnogkeeid8ihot8ih756a1amghon/family1/47d5625cc7f243eab0ab72ea1912e29f into 8e9e4ab39f8ae69643af213a16c22de1/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/9c1c7340b2bf48ba8813031063a2a962_SeqId_47_) 2023-11-02 21:55:40,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__e7h3enu2d2nqt8ceh8kf8qvbargpfh2ghbv4gnogkeeid8ihot8ih756a1amghon/family1/47d5625cc7f243eab0ab72ea1912e29f 2023-11-02 21:55:40,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-02 21:55:40,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-02 21:55:40,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 8e9e4ab39f8ae69643af213a16c22de1/family1 is initiating minor compaction (all files) 2023-11-02 21:55:40,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@511af1b9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:55:40,109 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8e9e4ab39f8ae69643af213a16c22de1/family1 in testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:55:40,109 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/cc77e6a13a164d62b841538a7b526f26, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/a521c0f7a3b74947bc4758632fec3a7f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/9c1c7340b2bf48ba8813031063a2a962_SeqId_47_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp, totalSize=178.1 K 2023-11-02 21:55:40,110 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting cc77e6a13a164d62b841538a7b526f26, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878810443 2023-11-02 21:55:40,111 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting a521c0f7a3b74947bc4758632fec3a7f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621210443 2023-11-02 21:55:40,111 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 9c1c7340b2bf48ba8813031063a2a962_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965210443 2023-11-02 21:55:40,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:55:40,113 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:40,115 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512010abbcca53cd747eaa6e1c38d954b7d55 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512010abbcca53cd747eaa6e1c38d954b7d55 2023-11-02 21:55:40,116 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a8411fb9acfc4a01863b1f537a9ff514 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a8411fb9acfc4a01863b1f537a9ff514 2023-11-02 21:55:40,118 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228afd14a43fd3a4e8188481aa7cf56fe65 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228afd14a43fd3a4e8188481aa7cf56fe65 2023-11-02 21:55:40,119 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317e1385bea6e44e80995cb1440307bbe3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317e1385bea6e44e80995cb1440307bbe3 2023-11-02 21:55:40,119 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-02 21:55:40,119 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-02 21:55:40,120 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:55:40,121 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:55:40,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2b63045dcb65441ebf39d09c4962f631, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ecd4b0a15b294f73b337dde1a37e6306, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/4146768ac9784e71bbac97d7fc5f26bb, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2f99425dab984026abfc8c76741e0ffd, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/31ac008c28334bacb16adb14f4cf4a02, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/6a091cfa2c8149b7877ecd83dbd2ca42, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/25334d68f3dc4d2eb7f81d363f9ab922, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/aaeab6a2cf0c4bc2848cb11fa45ccfa5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/47a9dbc58d874adaa6eea41fd3bf53f9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ce88923f294f4f279ea5da27e62eddc4_SeqId_44_] to archive 2023-11-02 21:55:40,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:40,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2b63045dcb65441ebf39d09c4962f631 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2b63045dcb65441ebf39d09c4962f631 2023-11-02 21:55:40,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ecd4b0a15b294f73b337dde1a37e6306 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ecd4b0a15b294f73b337dde1a37e6306 2023-11-02 21:55:40,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/4146768ac9784e71bbac97d7fc5f26bb to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/4146768ac9784e71bbac97d7fc5f26bb 2023-11-02 21:55:40,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2f99425dab984026abfc8c76741e0ffd to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/2f99425dab984026abfc8c76741e0ffd 2023-11-02 21:55:40,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/31ac008c28334bacb16adb14f4cf4a02 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/31ac008c28334bacb16adb14f4cf4a02 2023-11-02 21:55:40,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/6a091cfa2c8149b7877ecd83dbd2ca42 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/6a091cfa2c8149b7877ecd83dbd2ca42 2023-11-02 21:55:40,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/25334d68f3dc4d2eb7f81d363f9ab922 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/25334d68f3dc4d2eb7f81d363f9ab922 2023-11-02 21:55:40,144 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/aaeab6a2cf0c4bc2848cb11fa45ccfa5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/aaeab6a2cf0c4bc2848cb11fa45ccfa5 2023-11-02 21:55:40,146 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/47a9dbc58d874adaa6eea41fd3bf53f9 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/47a9dbc58d874adaa6eea41fd3bf53f9 2023-11-02 21:55:40,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ce88923f294f4f279ea5da27e62eddc4_SeqId_44_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/ce88923f294f4f279ea5da27e62eddc4_SeqId_44_ 2023-11-02 21:55:40,153 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8e9e4ab39f8ae69643af213a16c22de1#family1#compaction#23 average throughput is 6.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:55:40,587 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e74c4515869b4742af1d7548b5eb7f22 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130e74c4515869b4742af1d7548b5eb7f22 2023-11-02 21:55:40,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:55:40,618 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e6e1b83c207c45a08dc1bbf20b8ce048 first=Optional[r00] last=Optional[r8] 2023-11-02 21:55:40,619 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e6e1b83c207c45a08dc1bbf20b8ce048}] 2023-11-02 21:55:40,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e6e1b83c207c45a08dc1bbf20b8ce048 for inclusion in 8e9e4ab39f8ae69643af213a16c22de1/family1 2023-11-02 21:55:40,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-02 21:55:40,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:55:40,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:40,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e6e1b83c207c45a08dc1bbf20b8ce048 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rdpvbjrgh24g3eqj6tnbbs0vf495h3hit7uo8v5a471ar5bh7jpofsicuaqsm08k/family1/e6e1b83c207c45a08dc1bbf20b8ce048 2023-11-02 21:55:40,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rdpvbjrgh24g3eqj6tnbbs0vf495h3hit7uo8v5a471ar5bh7jpofsicuaqsm08k/family1/e6e1b83c207c45a08dc1bbf20b8ce048 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/33d7db7d9773453ea5944f1085e21ede_SeqId_49_ 2023-11-02 21:55:40,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rdpvbjrgh24g3eqj6tnbbs0vf495h3hit7uo8v5a471ar5bh7jpofsicuaqsm08k/family1/e6e1b83c207c45a08dc1bbf20b8ce048 into 8e9e4ab39f8ae69643af213a16c22de1/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/33d7db7d9773453ea5944f1085e21ede_SeqId_49_ - updating store file list. 2023-11-02 21:55:40,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/33d7db7d9773453ea5944f1085e21ede_SeqId_49_ into 8e9e4ab39f8ae69643af213a16c22de1/family1 2023-11-02 21:55:40,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rdpvbjrgh24g3eqj6tnbbs0vf495h3hit7uo8v5a471ar5bh7jpofsicuaqsm08k/family1/e6e1b83c207c45a08dc1bbf20b8ce048 into 8e9e4ab39f8ae69643af213a16c22de1/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/33d7db7d9773453ea5944f1085e21ede_SeqId_49_) 2023-11-02 21:55:40,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rdpvbjrgh24g3eqj6tnbbs0vf495h3hit7uo8v5a471ar5bh7jpofsicuaqsm08k/family1/e6e1b83c207c45a08dc1bbf20b8ce048 2023-11-02 21:55:40,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:55:40,636 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:40,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120f27b2acaa56c4917a6d63c4a23735ca8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120f27b2acaa56c4917a6d63c4a23735ca8 2023-11-02 21:55:40,639 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511281609b9e1d0bd4a249e93b8fe20679503 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511281609b9e1d0bd4a249e93b8fe20679503 2023-11-02 21:55:40,641 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130cc80234d64cd4618a81f7379f623aefe to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130cc80234d64cd4618a81f7379f623aefe 2023-11-02 21:55:40,641 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-02 21:55:40,641 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-02 21:55:40,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:55:40,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:55:40,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:55:40,642 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:55:40,642 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:55:40,643 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:55:40,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.3910 sec 2023-11-02 21:55:40,759 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=261 (was 253) Potentially hanging thread: hconnection-0x894db35-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1993670402_17 at /127.0.0.1:40174 [Receiving block BP-263132594-136.243.104.168-1698962100113:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49550@0x1b1e1462-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57092 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1993670402_17 at /127.0.0.1:40164 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57260 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57226 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x894db35-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57256 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x894db35-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57174 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x894db35-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57204 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/cluster_447f0e9b-ccb8-1ecb-10d1-87f66cbaf59a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x894db35-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57276 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57218 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57158 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231eb83398dc3d84c15b963a4cc14c4afcd java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x894db35-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57208 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49550@0x1b1e1462-SendThread(127.0.0.1:49550) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57132 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/cluster_447f0e9b-ccb8-1ecb-10d1-87f66cbaf59a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57186 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57250 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-263132594-136.243.104.168-1698962100113:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:40170 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57176 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-37366865_17 at /127.0.0.1:57206 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x894db35-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/e7d8e43533174504a8188783a64040e9 block BP-263132594-136.243.104.168-1698962100113:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49550@0x1b1e1462 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/677244075.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-263132594-136.243.104.168-1698962100113:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) - Thread LEAK? -, OpenFileDescriptor=644 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=261 (was 299), ProcessCount=174 (was 174), AvailableMemoryMB=863 (was 1182) 2023-11-02 21:55:40,772 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=261, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=261, ProcessCount=174, AvailableMemoryMB=862 2023-11-02 21:55:40,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-02 21:55:40,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:40,777 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:55:40,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-02 21:55:40,778 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:55:40,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-02 21:55:40,780 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8 2023-11-02 21:55:40,780 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8 empty. 2023-11-02 21:55:40,781 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8 2023-11-02 21:55:40,781 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-02 21:55:40,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-02 21:55:41,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-02 21:55:41,192 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-02 21:55:41,196 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => c8c87357778eb61d30f523cb6ae1f5a8, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:55:41,380 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/.tmp/family1/e7d8e43533174504a8188783a64040e9 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/e7d8e43533174504a8188783a64040e9 2023-11-02 21:55:41,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-02 21:55:41,390 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8e9e4ab39f8ae69643af213a16c22de1/family1 of 8e9e4ab39f8ae69643af213a16c22de1 into e7d8e43533174504a8188783a64040e9(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:55:41,390 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:55:41,391 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698962140109; duration=1sec 2023-11-02 21:55:41,391 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:55:41,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/cc77e6a13a164d62b841538a7b526f26, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/a521c0f7a3b74947bc4758632fec3a7f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/9c1c7340b2bf48ba8813031063a2a962_SeqId_47_] to archive 2023-11-02 21:55:41,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:41,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/cc77e6a13a164d62b841538a7b526f26 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/cc77e6a13a164d62b841538a7b526f26 2023-11-02 21:55:41,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/a521c0f7a3b74947bc4758632fec3a7f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/a521c0f7a3b74947bc4758632fec3a7f 2023-11-02 21:55:41,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/9c1c7340b2bf48ba8813031063a2a962_SeqId_47_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/family1/9c1c7340b2bf48ba8813031063a2a962_SeqId_47_ 2023-11-02 21:55:41,606 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:41,607 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing c8c87357778eb61d30f523cb6ae1f5a8, disabling compactions & flushes 2023-11-02 21:55:41,607 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:41,607 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:41,608 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. after waiting 0 ms 2023-11-02 21:55:41,608 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:41,608 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:41,608 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:41,614 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:55:41,615 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698962141615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962141615"}]},"ts":"1698962141615"} 2023-11-02 21:55:41,617 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-02 21:55:41,618 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:55:41,619 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962141619"}]},"ts":"1698962141619"} 2023-11-02 21:55:41,620 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-02 21:55:41,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c8c87357778eb61d30f523cb6ae1f5a8, ASSIGN}] 2023-11-02 21:55:41,701 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c8c87357778eb61d30f523cb6ae1f5a8, ASSIGN 2023-11-02 21:55:41,705 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c8c87357778eb61d30f523cb6ae1f5a8, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:55:41,856 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=c8c87357778eb61d30f523cb6ae1f5a8, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:41,856 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698962141856"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962141856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962141856"}]},"ts":"1698962141856"} 2023-11-02 21:55:41,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure c8c87357778eb61d30f523cb6ae1f5a8, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:55:41,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-02 21:55:42,011 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:42,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:42,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c8c87357778eb61d30f523cb6ae1f5a8, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:55:42,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy c8c87357778eb61d30f523cb6ae1f5a8 2023-11-02 21:55:42,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:42,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for c8c87357778eb61d30f523cb6ae1f5a8 2023-11-02 21:55:42,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for c8c87357778eb61d30f523cb6ae1f5a8 2023-11-02 21:55:42,020 INFO [StoreOpener-c8c87357778eb61d30f523cb6ae1f5a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c8c87357778eb61d30f523cb6ae1f5a8 2023-11-02 21:55:42,023 DEBUG [StoreOpener-c8c87357778eb61d30f523cb6ae1f5a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1 2023-11-02 21:55:42,023 DEBUG [StoreOpener-c8c87357778eb61d30f523cb6ae1f5a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1 2023-11-02 21:55:42,024 INFO [StoreOpener-c8c87357778eb61d30f523cb6ae1f5a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8c87357778eb61d30f523cb6ae1f5a8 columnFamilyName family1 2023-11-02 21:55:42,026 INFO [StoreOpener-c8c87357778eb61d30f523cb6ae1f5a8-1] regionserver.HStore(310): Store=c8c87357778eb61d30f523cb6ae1f5a8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:42,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8 2023-11-02 21:55:42,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8 2023-11-02 21:55:42,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for c8c87357778eb61d30f523cb6ae1f5a8 2023-11-02 21:55:42,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:55:42,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened c8c87357778eb61d30f523cb6ae1f5a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66094534, jitterRate=-0.015114694833755493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:55:42,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:42,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8., pid=25, masterSystemTime=1698962142011 2023-11-02 21:55:42,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:42,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:42,040 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=c8c87357778eb61d30f523cb6ae1f5a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:42,040 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698962142039"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962142039"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962142039"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962142039"}]},"ts":"1698962142039"} 2023-11-02 21:55:42,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-02 21:55:42,044 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure c8c87357778eb61d30f523cb6ae1f5a8, server=jenkins-hbase12.apache.org,33583,1698962105160 in 183 msec 2023-11-02 21:55:42,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-02 21:55:42,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c8c87357778eb61d30f523cb6ae1f5a8, ASSIGN in 348 msec 2023-11-02 21:55:42,047 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:55:42,047 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962142047"}]},"ts":"1698962142047"} 2023-11-02 21:55:42,048 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-02 21:55:42,061 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:55:42,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.2860 sec 2023-11-02 21:55:42,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-02 21:55:42,886 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-02 21:55:42,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:42,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:42,921 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:42,921 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:42,922 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:55:42,922 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:42,922 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:42,922 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:42,969 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:42,969 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:42,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:42,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:42,969 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:42,969 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:42,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:42,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:42,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:42,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:42,971 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:42,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:42,971 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:55:42,971 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:42,971 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:55:42,971 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:42,971 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:42,971 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:42,972 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. started... 2023-11-02 21:55:42,972 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8c87357778eb61d30f523cb6ae1f5a8 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-02 21:55:43,400 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130684ead4025644c79a1bebe4088ca3c56 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130684ead4025644c79a1bebe4088ca3c56 2023-11-02 21:55:43,807 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/68a71dab818348db84c642343dac0094 2023-11-02 21:55:43,819 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/68a71dab818348db84c642343dac0094 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/68a71dab818348db84c642343dac0094 2023-11-02 21:55:43,825 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/68a71dab818348db84c642343dac0094, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-02 21:55:43,826 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c8c87357778eb61d30f523cb6ae1f5a8 in 854ms, sequenceid=5, compaction requested=false 2023-11-02 21:55:43,826 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:43,826 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:43,826 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:43,826 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:43,827 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:43,827 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,827 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:55:43,827 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:55:43,906 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,906 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:43,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:43,907 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,907 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:43,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:43,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:43,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:43,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:55:43,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5303976e[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:43,910 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:43,910 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,923 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,923 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:43,923 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:55:43,923 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:43,923 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,923 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:43,933 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:55:43,933 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,933 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:43,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:43,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:43,933 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:55:43,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:43,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:43,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:43,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:43,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:43,936 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:55:43,936 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:43,936 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:43,936 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,936 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:43,948 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,948 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:43,948 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:43,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:43,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:43,949 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:43,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,951 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:43,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,965 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,965 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:43,965 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,965 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:43,965 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:43,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:43,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:43,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:43,965 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,966 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:43,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:43,966 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:43,966 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:43,966 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,967 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,967 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:43,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:43,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:44,067 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:44,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:44,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:44,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:44,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:44,076 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:44,076 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:44,076 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:55:44,076 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:44,077 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:44,077 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:44,085 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:44,085 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:44,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:44,086 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:44,086 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:44,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:44,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:44,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:44,087 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:44,087 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:55:44,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:44,087 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:55:44,087 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:44,087 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:55:44,088 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:44,088 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:44,088 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:44,088 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. started... 2023-11-02 21:55:44,088 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8c87357778eb61d30f523cb6ae1f5a8 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-02 21:55:44,505 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283f9633791a7e41799b185329b037622f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511283f9633791a7e41799b185329b037622f 2023-11-02 21:55:44,911 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/afef835c078c4364bac39a42c3005822 2023-11-02 21:55:44,923 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/afef835c078c4364bac39a42c3005822 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/afef835c078c4364bac39a42c3005822 2023-11-02 21:55:44,928 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/afef835c078c4364bac39a42c3005822, entries=1, sequenceid=9, filesize=5.0 K 2023-11-02 21:55:44,929 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c8c87357778eb61d30f523cb6ae1f5a8 in 841ms, sequenceid=9, compaction requested=false 2023-11-02 21:55:44,930 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:44,930 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:44,930 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:44,930 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:44,930 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:44,930 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:55:44,930 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:55:45,010 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,010 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:45,011 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,011 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:45,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:45,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:55:45,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25802574[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:45,018 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:45,018 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,039 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,040 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:45,040 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:55:45,040 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:45,040 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,040 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:45,054 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:55:45,054 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:45,054 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:55:45,054 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:45,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:45,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:45,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:45,068 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:55:45,068 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:45,068 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:45,068 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,068 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:45,081 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,081 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,081 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:45,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:45,082 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:45,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,086 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:45,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,102 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,102 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,102 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,102 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:45,102 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:45,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:45,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:45,102 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:45,102 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:45,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-02 21:55:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:45,102 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,102 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:45,103 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,103 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:45,103 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:45,203 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:45,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:45,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:45,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:45,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,212 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:45,212 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:45,212 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:55:45,212 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:45,213 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,213 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,222 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:45,222 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:45,222 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:45,222 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,223 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,223 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:55:45,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:45,223 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:55:45,223 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:45,223 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:55:45,224 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:45,224 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:45,224 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:45,224 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. started... 2023-11-02 21:55:45,224 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8c87357778eb61d30f523cb6ae1f5a8 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:45,640 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201003f10fadd9c437c97d326afd200ad07 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201003f10fadd9c437c97d326afd200ad07 2023-11-02 21:55:46,048 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/71298207d4df47bfb68277b1f36b94e0 2023-11-02 21:55:46,061 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/71298207d4df47bfb68277b1f36b94e0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/71298207d4df47bfb68277b1f36b94e0 2023-11-02 21:55:46,067 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/71298207d4df47bfb68277b1f36b94e0, entries=1, sequenceid=13, filesize=4.9 K 2023-11-02 21:55:46,068 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8c87357778eb61d30f523cb6ae1f5a8 in 844ms, sequenceid=13, compaction requested=true 2023-11-02 21:55:46,069 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:46,069 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:46,069 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:46,069 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:46,069 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,069 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:55:46,069 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:55:46,127 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,127 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:46,128 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,128 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:46,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:46,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:46,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:46,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:55:46,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71b3189a[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:46,132 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:46,132 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,144 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,144 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:46,144 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:55:46,144 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:46,144 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,144 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:46,196 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,196 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:55:46,197 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:46,197 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:55:46,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:46,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:46,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:46,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:46,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:46,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:46,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:46,200 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:55:46,200 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:46,200 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:46,200 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,200 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:46,284 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,284 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:46,284 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:46,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:46,286 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:46,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,288 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,316 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,316 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:46,316 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:46,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:46,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:46,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:46,317 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:46,317 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,317 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:46,317 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:46,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-02 21:55:46,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:46,317 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:46,317 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,317 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:46,317 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,318 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,418 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:46,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:46,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:46,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:46,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,432 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:46,432 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:46,432 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:55:46,432 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:46,433 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,433 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,443 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,443 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:46,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:46,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:46,443 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:46,443 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:46,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:46,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,446 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:55:46,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:46,446 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:55:46,446 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:46,446 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:55:46,447 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:46,447 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:46,447 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:46,447 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. started... 2023-11-02 21:55:46,447 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8c87357778eb61d30f523cb6ae1f5a8 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:46,873 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054e2cd91868404067be4bf081d1eec92b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512054e2cd91868404067be4bf081d1eec92b 2023-11-02 21:55:47,282 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/223afb18d52e4912b6d119030042ad43 2023-11-02 21:55:47,293 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/223afb18d52e4912b6d119030042ad43 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/223afb18d52e4912b6d119030042ad43 2023-11-02 21:55:47,300 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/223afb18d52e4912b6d119030042ad43, entries=1, sequenceid=17, filesize=4.9 K 2023-11-02 21:55:47,301 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8c87357778eb61d30f523cb6ae1f5a8 in 854ms, sequenceid=17, compaction requested=true 2023-11-02 21:55:47,301 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:47,301 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:47,301 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:47,302 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:47,302 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,302 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:55:47,302 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:55:47,422 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,422 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:47,422 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,422 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:47,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:47,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:55:47,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18ec95f5[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:47,425 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:47,426 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,439 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,439 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:47,439 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:55:47,439 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:47,440 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,440 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:47,453 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:55:47,453 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:47,453 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:55:47,453 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:47,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:47,456 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:55:47,456 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:47,456 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:47,456 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,456 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:47,463 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,464 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,464 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:47,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:47,464 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,465 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,507 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,507 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:47,507 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,507 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:47,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:47,507 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:47,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-02 21:55:47,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:47,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:47,507 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,508 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:47,508 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,508 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:47,509 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,509 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:47,509 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,555 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:55:47,609 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:47,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:47,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:47,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:47,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,619 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:47,619 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:47,619 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:55:47,619 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:47,620 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,620 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:47,643 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:47,644 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:47,644 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,646 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,646 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:55:47,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:47,646 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:55:47,647 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:47,647 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:55:47,647 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:47,647 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:47,647 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:47,647 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. started... 2023-11-02 21:55:47,647 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8c87357778eb61d30f523cb6ae1f5a8 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:48,072 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122808813293603d4abb8a0988faa7f0bc42 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122808813293603d4abb8a0988faa7f0bc42 2023-11-02 21:55:48,480 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/860407caad9c419e883d5c20b4748ce5 2023-11-02 21:55:48,489 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/860407caad9c419e883d5c20b4748ce5 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/860407caad9c419e883d5c20b4748ce5 2023-11-02 21:55:48,497 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/860407caad9c419e883d5c20b4748ce5, entries=1, sequenceid=21, filesize=4.9 K 2023-11-02 21:55:48,498 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8c87357778eb61d30f523cb6ae1f5a8 in 851ms, sequenceid=21, compaction requested=true 2023-11-02 21:55:48,498 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:48,498 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:48,498 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:48,498 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:48,498 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,498 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:55:48,498 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:55:48,569 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,569 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:48,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:48,570 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,571 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:48,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:48,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:55:48,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@571bd961[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:48,577 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:48,577 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,590 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,590 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:48,590 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:55:48,591 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:48,591 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,591 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:48,601 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:55:48,601 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:48,601 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:55:48,601 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:48,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:48,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:48,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:48,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:48,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:48,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:48,610 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:55:48,611 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:48,611 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:48,611 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,611 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:48,622 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,622 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:48,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:48,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,622 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:48,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:48,623 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,627 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,642 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,642 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:48,643 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:48,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:48,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:48,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:48,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:48,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:48,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,643 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:48,643 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:48,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:48,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:48,743 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:48,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:48,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:48,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:48,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,758 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:48,758 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:48,758 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:55:48,759 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:48,759 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,759 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,769 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,769 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:48,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:48,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:48,770 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:48,770 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:48,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,772 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,772 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:55:48,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:48,773 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:55:48,773 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:48,773 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:55:48,773 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:48,773 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:48,773 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:48,773 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. started... 2023-11-02 21:55:48,773 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8c87357778eb61d30f523cb6ae1f5a8 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:49,192 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a31ff6960a4d478da8853c4d117bc3df to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231a31ff6960a4d478da8853c4d117bc3df 2023-11-02 21:55:49,600 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/ba19fe3f99854bdca8c165a8ae6e90ca 2023-11-02 21:55:49,614 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/ba19fe3f99854bdca8c165a8ae6e90ca as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba19fe3f99854bdca8c165a8ae6e90ca 2023-11-02 21:55:49,622 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba19fe3f99854bdca8c165a8ae6e90ca, entries=1, sequenceid=25, filesize=4.9 K 2023-11-02 21:55:49,623 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8c87357778eb61d30f523cb6ae1f5a8 in 850ms, sequenceid=25, compaction requested=true 2023-11-02 21:55:49,623 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:49,624 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:49,624 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:49,624 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:49,624 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,624 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:55:49,624 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:55:49,717 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,717 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:49,718 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,718 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:49,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:49,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:55:49,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7314ed73[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:49,725 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:49,725 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,737 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,738 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:49,738 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:55:49,738 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:49,738 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,738 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:49,748 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:55:49,748 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,748 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:49,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,748 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:55:49,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:49,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:49,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:49,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:49,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:49,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:49,756 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:55:49,756 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:49,756 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:49,756 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:49,756 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:49,769 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,769 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:49,769 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:49,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:49,770 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:49,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:49,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,772 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:49,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:49,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-02 21:55:49,786 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:49,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:49,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:49,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:49,886 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:49,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:49,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:49,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:49,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,902 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:49,902 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:49,902 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:55:49,902 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:49,903 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,903 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,912 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:49,912 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:49,913 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:49,913 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:49,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,916 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,916 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:55:49,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:49,917 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:55:49,917 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:49,917 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:55:49,917 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:49,917 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:49,917 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:49,917 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. started... 2023-11-02 21:55:49,918 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8c87357778eb61d30f523cb6ae1f5a8 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:50,333 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013efdde211c7a4aafb8d36e5b96989df4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013efdde211c7a4aafb8d36e5b96989df4 2023-11-02 21:55:50,741 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/8eaba01d9ea442acb147bde1f3953c23 2023-11-02 21:55:50,748 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/8eaba01d9ea442acb147bde1f3953c23 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/8eaba01d9ea442acb147bde1f3953c23 2023-11-02 21:55:50,753 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/8eaba01d9ea442acb147bde1f3953c23, entries=1, sequenceid=29, filesize=4.9 K 2023-11-02 21:55:50,754 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8c87357778eb61d30f523cb6ae1f5a8 in 836ms, sequenceid=29, compaction requested=true 2023-11-02 21:55:50,754 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:50,754 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:50,754 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:50,754 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:50,754 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:50,754 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:55:50,754 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:55:50,839 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:50,839 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:50,840 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:50,840 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:50,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:50,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:50,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:50,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:50,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:50,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:55:50,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a8a5c43[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:50,846 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:50,847 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:50,925 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:50,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:50,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:50,926 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:50,926 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:55:50,926 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:50,926 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:50,926 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:50,993 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:50,993 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:55:50,993 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:50,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:50,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:50,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:50,993 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:55:50,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:50,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:50,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:50,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:51,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:51,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:51,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:51,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:51,005 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:55:51,005 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:51,005 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:51,005 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,005 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:51,028 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,028 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,028 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:51,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:51,029 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:51,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:51,030 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:51,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:51,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:51,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:51,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:51,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:51,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:51,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:51,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:51,043 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:51,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:51,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:51,044 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,044 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,044 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:51,044 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:51,145 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:51,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:51,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:51,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:51,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,156 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:51,156 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:51,156 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:55:51,156 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:51,156 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,156 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,169 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:51,169 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:51,170 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:51,170 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:51,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,172 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,173 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:55:51,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:51,173 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:55:51,173 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:51,173 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:55:51,173 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:51,174 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:51,174 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:51,174 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. started... 2023-11-02 21:55:51,174 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8c87357778eb61d30f523cb6ae1f5a8 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:51,591 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103525643de6d144f1b9c4f7bf7a063abc6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103525643de6d144f1b9c4f7bf7a063abc6 2023-11-02 21:55:51,997 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/9cdef5827fb3412685d053e693b2a00e 2023-11-02 21:55:52,002 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/9cdef5827fb3412685d053e693b2a00e as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/9cdef5827fb3412685d053e693b2a00e 2023-11-02 21:55:52,007 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/9cdef5827fb3412685d053e693b2a00e, entries=1, sequenceid=33, filesize=4.9 K 2023-11-02 21:55:52,008 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8c87357778eb61d30f523cb6ae1f5a8 in 834ms, sequenceid=33, compaction requested=true 2023-11-02 21:55:52,008 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:52,009 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:52,009 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:52,009 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:52,009 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,009 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:55:52,009 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:55:52,116 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,116 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:52,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:52,117 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,117 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:52,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:52,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:52,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:52,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:55:52,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@663531da[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:52,119 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:52,119 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,126 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,127 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:52,127 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:55:52,127 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:52,127 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,127 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:52,137 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,137 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:55:52,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:52,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:52,137 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:52,137 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:55:52,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:52,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:52,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:52,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:52,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:52,142 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:55:52,142 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:52,142 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:52,142 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,142 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:52,154 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,154 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:52,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:52,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,154 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:52,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:52,155 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:52,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:52,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:52,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,158 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:52,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,169 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,169 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:52,169 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:52,169 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:52,169 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:52,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:52,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:52,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:52,169 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,169 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,170 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,170 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,170 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,170 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:52,170 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:52,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:52,270 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:52,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:52,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:52,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:52,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,284 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:52,284 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:52,284 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:55:52,284 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:52,285 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,285 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,295 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,295 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:52,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:52,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:52,296 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:52,296 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:52,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:52,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,298 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,299 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:55:52,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:52,299 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:55:52,299 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:52,299 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:55:52,300 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:52,300 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:52,300 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:52,300 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. started... 2023-11-02 21:55:52,300 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8c87357778eb61d30f523cb6ae1f5a8 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:52,727 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d55e7a4ff67348a29323363698a2a981 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907d55e7a4ff67348a29323363698a2a981 2023-11-02 21:55:53,136 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/072c237a56f14289a4f6541e17f322b5 2023-11-02 21:55:53,145 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/072c237a56f14289a4f6541e17f322b5 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/072c237a56f14289a4f6541e17f322b5 2023-11-02 21:55:53,152 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/072c237a56f14289a4f6541e17f322b5, entries=1, sequenceid=37, filesize=4.9 K 2023-11-02 21:55:53,153 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8c87357778eb61d30f523cb6ae1f5a8 in 853ms, sequenceid=37, compaction requested=true 2023-11-02 21:55:53,153 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:53,153 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:53,154 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:53,154 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:53,154 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,154 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:55:53,154 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:55:53,211 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,211 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:53,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:53,212 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:53,212 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:53,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:53,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:53,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:55:53,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fec3cac[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:53,216 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:53,216 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,228 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,228 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:53,228 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:55:53,228 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:53,228 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,229 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:53,238 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,238 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:55:53,239 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:53,239 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:55:53,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:53,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:53,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:53,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:53,247 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:55:53,247 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:53,247 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:53,247 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,247 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:53,259 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,259 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:53,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:53,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,260 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:53,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:53,261 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:53,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:53,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:53,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,265 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:53,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:53,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:53,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:53,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:53,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,281 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:53,281 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:53,281 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:53,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:53,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:53,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,282 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:53,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:53,382 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:53,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:53,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:53,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:53,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,398 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:53,398 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:53,398 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:55:53,398 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:55:53,399 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,399 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,428 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,428 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:53,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:53,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:53,428 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:53,429 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:53,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:53,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,430 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,431 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:55:53,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:53,431 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:55:53,431 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:53,431 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:55:53,432 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:55:53,432 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:53,432 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:53,432 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. started... 2023-11-02 21:55:53,432 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8c87357778eb61d30f523cb6ae1f5a8 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:55:53,852 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200c473b1dda5e4f8bab6ef6fb44ac38cf to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511200c473b1dda5e4f8bab6ef6fb44ac38cf 2023-11-02 21:55:54,262 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/91b670c52b4a4f489dd3ec9decafd771 2023-11-02 21:55:54,274 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/91b670c52b4a4f489dd3ec9decafd771 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/91b670c52b4a4f489dd3ec9decafd771 2023-11-02 21:55:54,279 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/91b670c52b4a4f489dd3ec9decafd771, entries=1, sequenceid=41, filesize=4.9 K 2023-11-02 21:55:54,280 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8c87357778eb61d30f523cb6ae1f5a8 in 848ms, sequenceid=41, compaction requested=true 2023-11-02 21:55:54,280 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:54,280 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:54,280 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:55:54,280 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:55:54,280 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,280 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:55:54,280 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:55:54,394 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,394 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:54,395 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,395 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:54,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:54,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:54,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:54,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:55:54,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b473b57[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:54,397 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:55:54,397 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,417 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,418 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:55:54,418 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:55:54,418 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:54,418 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,418 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:54,428 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:55:54,428 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:54,428 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:55:54,428 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:54,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:54,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:54,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:54,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:55:54,437 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:55:54,437 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:54,437 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:54,437 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,438 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:54,449 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,449 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,449 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:54,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:54,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:54,451 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:54,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,455 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:54,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,470 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,470 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:54,470 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:54,470 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-02 21:55:54,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:54,470 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:54,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:54,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-02 21:55:54,470 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:54,471 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:54,470 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,471 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:54,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:54,471 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,471 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,471 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:54,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:54,571 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:54,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:54,576 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-02 21:55:54,579 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:55:54,581 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:55:54,583 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:55:54,583 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962754583 2023-11-02 21:55:54,586 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-02 21:55:54,588 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-02 21:55:54,588 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:55:54,591 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x7359405b to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:55:54,611 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dba6076, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:55:54,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:55:55,463 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031ab6a65096d14b78be2210714495cd8a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601031ab6a65096d14b78be2210714495cd8a 2023-11-02 21:55:55,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:55:55,477 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:55:55,478 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:48548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:55:55,484 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:55:55,486 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:47968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:55:55,497 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f2910bed70684710ae4c36ba7a105e3e first=Optional[r3] last=Optional[r6] 2023-11-02 21:55:55,497 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f2910bed70684710ae4c36ba7a105e3e}] 2023-11-02 21:55:55,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f2910bed70684710ae4c36ba7a105e3e for inclusion in c8c87357778eb61d30f523cb6ae1f5a8/family1 2023-11-02 21:55:55,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-02 21:55:55,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:55:55,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:55,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f2910bed70684710ae4c36ba7a105e3e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f4idg025i87ujdksk8prn2iv0eievjtolq35so4b0f5udltn7mdm1ktp70hloqrs/family1/f2910bed70684710ae4c36ba7a105e3e 2023-11-02 21:55:55,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f4idg025i87ujdksk8prn2iv0eievjtolq35so4b0f5udltn7mdm1ktp70hloqrs/family1/f2910bed70684710ae4c36ba7a105e3e as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/b6d9a7c6aaf14a32a526b541d13615bb_SeqId_44_ 2023-11-02 21:55:55,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f4idg025i87ujdksk8prn2iv0eievjtolq35so4b0f5udltn7mdm1ktp70hloqrs/family1/f2910bed70684710ae4c36ba7a105e3e into c8c87357778eb61d30f523cb6ae1f5a8/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/b6d9a7c6aaf14a32a526b541d13615bb_SeqId_44_ - updating store file list. 2023-11-02 21:55:55,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/b6d9a7c6aaf14a32a526b541d13615bb_SeqId_44_ into c8c87357778eb61d30f523cb6ae1f5a8/family1 2023-11-02 21:55:55,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f4idg025i87ujdksk8prn2iv0eievjtolq35so4b0f5udltn7mdm1ktp70hloqrs/family1/f2910bed70684710ae4c36ba7a105e3e into c8c87357778eb61d30f523cb6ae1f5a8/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/b6d9a7c6aaf14a32a526b541d13615bb_SeqId_44_) 2023-11-02 21:55:55,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithWeeklyPolicy__f4idg025i87ujdksk8prn2iv0eievjtolq35so4b0f5udltn7mdm1ktp70hloqrs/family1/f2910bed70684710ae4c36ba7a105e3e 2023-11-02 21:55:55,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-02 21:55:55,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-02 21:55:55,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): c8c87357778eb61d30f523cb6ae1f5a8/family1 is initiating minor compaction 2023-11-02 21:55:55,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@41e77947; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-02 21:55:55,516 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c8c87357778eb61d30f523cb6ae1f5a8/family1 in testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:55,516 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/afef835c078c4364bac39a42c3005822, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/71298207d4df47bfb68277b1f36b94e0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/223afb18d52e4912b6d119030042ad43, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/860407caad9c419e883d5c20b4748ce5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba19fe3f99854bdca8c165a8ae6e90ca, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/8eaba01d9ea442acb147bde1f3953c23, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/9cdef5827fb3412685d053e693b2a00e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/072c237a56f14289a4f6541e17f322b5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/91b670c52b4a4f489dd3ec9decafd771, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/b6d9a7c6aaf14a32a526b541d13615bb_SeqId_44_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp, totalSize=50.0 K 2023-11-02 21:55:55,516 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting afef835c078c4364bac39a42c3005822, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-02 21:55:55,516 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 71298207d4df47bfb68277b1f36b94e0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-02 21:55:55,516 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 223afb18d52e4912b6d119030042ad43, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-02 21:55:55,517 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 860407caad9c419e883d5c20b4748ce5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-02 21:55:55,517 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting ba19fe3f99854bdca8c165a8ae6e90ca, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-02 21:55:55,517 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 8eaba01d9ea442acb147bde1f3953c23, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-02 21:55:55,517 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 9cdef5827fb3412685d053e693b2a00e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-02 21:55:55,517 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 072c237a56f14289a4f6541e17f322b5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-02 21:55:55,517 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 91b670c52b4a4f489dd3ec9decafd771, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-02 21:55:55,517 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting b6d9a7c6aaf14a32a526b541d13615bb_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-02 21:55:55,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:55:55,519 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:55,520 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122808813293603d4abb8a0988faa7f0bc42 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122808813293603d4abb8a0988faa7f0bc42 2023-11-02 21:55:55,521 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231a31ff6960a4d478da8853c4d117bc3df to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231a31ff6960a4d478da8853c4d117bc3df 2023-11-02 21:55:55,522 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013efdde211c7a4aafb8d36e5b96989df4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013efdde211c7a4aafb8d36e5b96989df4 2023-11-02 21:55:55,524 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103525643de6d144f1b9c4f7bf7a063abc6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103525643de6d144f1b9c4f7bf7a063abc6 2023-11-02 21:55:55,524 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-02 21:55:55,524 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-02 21:55:55,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:55:55,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:55:55,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:55:55,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:55:55,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:55:55,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:55:55,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:55:55,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:55:55,549 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): c8c87357778eb61d30f523cb6ae1f5a8#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:55:55,968 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/ba03dd1f02484a43a816001b5eaf0700 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba03dd1f02484a43a816001b5eaf0700 2023-11-02 21:55:55,974 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c8c87357778eb61d30f523cb6ae1f5a8/family1 of c8c87357778eb61d30f523cb6ae1f5a8 into ba03dd1f02484a43a816001b5eaf0700(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:55:55,974 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:55,974 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698962155516; duration=0sec 2023-11-02 21:55:55,974 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:55:56,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/afef835c078c4364bac39a42c3005822, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/71298207d4df47bfb68277b1f36b94e0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/223afb18d52e4912b6d119030042ad43, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/860407caad9c419e883d5c20b4748ce5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba19fe3f99854bdca8c165a8ae6e90ca, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/8eaba01d9ea442acb147bde1f3953c23, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/9cdef5827fb3412685d053e693b2a00e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/072c237a56f14289a4f6541e17f322b5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/91b670c52b4a4f489dd3ec9decafd771, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/b6d9a7c6aaf14a32a526b541d13615bb_SeqId_44_] to archive 2023-11-02 21:55:56,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:56,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/afef835c078c4364bac39a42c3005822 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/afef835c078c4364bac39a42c3005822 2023-11-02 21:55:56,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/71298207d4df47bfb68277b1f36b94e0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/71298207d4df47bfb68277b1f36b94e0 2023-11-02 21:55:56,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/223afb18d52e4912b6d119030042ad43 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/223afb18d52e4912b6d119030042ad43 2023-11-02 21:55:56,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/860407caad9c419e883d5c20b4748ce5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/860407caad9c419e883d5c20b4748ce5 2023-11-02 21:55:56,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba19fe3f99854bdca8c165a8ae6e90ca to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba19fe3f99854bdca8c165a8ae6e90ca 2023-11-02 21:55:56,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/8eaba01d9ea442acb147bde1f3953c23 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/8eaba01d9ea442acb147bde1f3953c23 2023-11-02 21:55:56,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/9cdef5827fb3412685d053e693b2a00e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/9cdef5827fb3412685d053e693b2a00e 2023-11-02 21:55:56,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/072c237a56f14289a4f6541e17f322b5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/072c237a56f14289a4f6541e17f322b5 2023-11-02 21:55:56,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/91b670c52b4a4f489dd3ec9decafd771 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/91b670c52b4a4f489dd3ec9decafd771 2023-11-02 21:55:56,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/b6d9a7c6aaf14a32a526b541d13615bb_SeqId_44_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/b6d9a7c6aaf14a32a526b541d13615bb_SeqId_44_ 2023-11-02 21:55:56,370 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120573cdbe690f6e46cab8c749f8683a911a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120573cdbe690f6e46cab8c749f8683a911a 2023-11-02 21:55:56,372 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:55:56,401 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f3f55f858a6c4848814111cf4b41263f first=Optional[r1] last=Optional[r2] 2023-11-02 21:55:56,401 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f3f55f858a6c4848814111cf4b41263f}] 2023-11-02 21:55:56,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f3f55f858a6c4848814111cf4b41263f for inclusion in c8c87357778eb61d30f523cb6ae1f5a8/family1 2023-11-02 21:55:56,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-02 21:55:56,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:55:56,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:56,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f3f55f858a6c4848814111cf4b41263f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1ld8lg03sgdgc5hgcqccb9bf47fjrhamk9qta7ofjpb86gnkh3ne4ubshe8ghm0o/family1/f3f55f858a6c4848814111cf4b41263f 2023-11-02 21:55:56,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1ld8lg03sgdgc5hgcqccb9bf47fjrhamk9qta7ofjpb86gnkh3ne4ubshe8ghm0o/family1/f3f55f858a6c4848814111cf4b41263f as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ef6f8e8bd2f242d6bce0738da5d88a7c_SeqId_47_ 2023-11-02 21:55:56,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1ld8lg03sgdgc5hgcqccb9bf47fjrhamk9qta7ofjpb86gnkh3ne4ubshe8ghm0o/family1/f3f55f858a6c4848814111cf4b41263f into c8c87357778eb61d30f523cb6ae1f5a8/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ef6f8e8bd2f242d6bce0738da5d88a7c_SeqId_47_ - updating store file list. 2023-11-02 21:55:56,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ef6f8e8bd2f242d6bce0738da5d88a7c_SeqId_47_ into c8c87357778eb61d30f523cb6ae1f5a8/family1 2023-11-02 21:55:56,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1ld8lg03sgdgc5hgcqccb9bf47fjrhamk9qta7ofjpb86gnkh3ne4ubshe8ghm0o/family1/f3f55f858a6c4848814111cf4b41263f into c8c87357778eb61d30f523cb6ae1f5a8/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ef6f8e8bd2f242d6bce0738da5d88a7c_SeqId_47_) 2023-11-02 21:55:56,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1ld8lg03sgdgc5hgcqccb9bf47fjrhamk9qta7ofjpb86gnkh3ne4ubshe8ghm0o/family1/f3f55f858a6c4848814111cf4b41263f 2023-11-02 21:55:56,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-02 21:55:56,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-02 21:55:56,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): c8c87357778eb61d30f523cb6ae1f5a8/family1 is initiating minor compaction (all files) 2023-11-02 21:55:56,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@51d9a345; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-02 21:55:56,425 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c8c87357778eb61d30f523cb6ae1f5a8/family1 in testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:55:56,425 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/68a71dab818348db84c642343dac0094, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba03dd1f02484a43a816001b5eaf0700, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ef6f8e8bd2f242d6bce0738da5d88a7c_SeqId_47_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp, totalSize=176.8 K 2023-11-02 21:55:56,425 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 68a71dab818348db84c642343dac0094, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878810443 2023-11-02 21:55:56,426 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting ba03dd1f02484a43a816001b5eaf0700, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621210443 2023-11-02 21:55:56,426 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting ef6f8e8bd2f242d6bce0738da5d88a7c_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965210443 2023-11-02 21:55:56,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:55:56,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:56,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201003f10fadd9c437c97d326afd200ad07 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201003f10fadd9c437c97d326afd200ad07 2023-11-02 21:55:56,430 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512054e2cd91868404067be4bf081d1eec92b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512054e2cd91868404067be4bf081d1eec92b 2023-11-02 21:55:56,430 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-02 21:55:56,430 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-02 21:55:56,431 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:55:56,431 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:55:56,431 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:55:56,432 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:55:56,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8550 sec 2023-11-02 21:55:56,445 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): c8c87357778eb61d30f523cb6ae1f5a8#family1#compaction#35 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:55:56,539 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=261 (was 261), OpenFileDescriptor=644 (was 644), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 261), ProcessCount=174 (was 174), AvailableMemoryMB=536 (was 862) 2023-11-02 21:55:56,551 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=261, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=211, ProcessCount=174, AvailableMemoryMB=536 2023-11-02 21:55:56,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-02 21:55:56,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:56,556 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:55:56,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-02 21:55:56,557 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:55:56,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-02 21:55:56,560 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:55:56,560 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c 2023-11-02 21:55:56,560 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:55:56,561 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8 empty. 2023-11-02 21:55:56,561 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c empty. 2023-11-02 21:55:56,561 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b empty. 2023-11-02 21:55:56,561 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:55:56,561 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c 2023-11-02 21:55:56,561 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:55:56,561 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-02 21:55:56,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-02 21:55:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-02 21:55:56,973 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-02 21:55:56,975 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2fbdea9497438f69e6da4fc12f119a9b, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:55:56,975 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 245a468c597d21bd747b336f9fe7855c, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:55:56,975 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => a60f818b223a39e20a92d5ad84ca38d8, NAME => 'testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:55:57,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 245a468c597d21bd747b336f9fe7855c, disabling compactions & flushes 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing a60f818b223a39e20a92d5ad84ca38d8, disabling compactions & flushes 2023-11-02 21:55:57,381 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 2fbdea9497438f69e6da4fc12f119a9b, disabling compactions & flushes 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:57,381 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. after waiting 0 ms 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:57,381 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 245a468c597d21bd747b336f9fe7855c: 2023-11-02 21:55:57,381 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:55:57,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:57,382 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:55:57,382 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. after waiting 0 ms 2023-11-02 21:55:57,382 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. after waiting 0 ms 2023-11-02 21:55:57,382 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:57,382 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:55:57,382 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:57,382 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:55:57,382 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for a60f818b223a39e20a92d5ad84ca38d8: 2023-11-02 21:55:57,382 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 2fbdea9497438f69e6da4fc12f119a9b: 2023-11-02 21:55:57,384 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:55:57,385 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698962157385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962157385"}]},"ts":"1698962157385"} 2023-11-02 21:55:57,385 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698962157385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962157385"}]},"ts":"1698962157385"} 2023-11-02 21:55:57,385 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698962157385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962157385"}]},"ts":"1698962157385"} 2023-11-02 21:55:57,388 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-02 21:55:57,389 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:55:57,389 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962157389"}]},"ts":"1698962157389"} 2023-11-02 21:55:57,390 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-02 21:55:57,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a60f818b223a39e20a92d5ad84ca38d8, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=245a468c597d21bd747b336f9fe7855c, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2fbdea9497438f69e6da4fc12f119a9b, ASSIGN}] 2023-11-02 21:55:57,487 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2fbdea9497438f69e6da4fc12f119a9b, ASSIGN 2023-11-02 21:55:57,487 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=245a468c597d21bd747b336f9fe7855c, ASSIGN 2023-11-02 21:55:57,488 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a60f818b223a39e20a92d5ad84ca38d8, ASSIGN 2023-11-02 21:55:57,489 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a60f818b223a39e20a92d5ad84ca38d8, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:55:57,489 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=245a468c597d21bd747b336f9fe7855c, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:55:57,489 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2fbdea9497438f69e6da4fc12f119a9b, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:55:57,642 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a60f818b223a39e20a92d5ad84ca38d8, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:57,642 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2fbdea9497438f69e6da4fc12f119a9b, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:57,642 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=245a468c597d21bd747b336f9fe7855c, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:57,642 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698962157642"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962157642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962157642"}]},"ts":"1698962157642"} 2023-11-02 21:55:57,643 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698962157642"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962157642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962157642"}]},"ts":"1698962157642"} 2023-11-02 21:55:57,642 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698962157642"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962157642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962157642"}]},"ts":"1698962157642"} 2023-11-02 21:55:57,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 2fbdea9497438f69e6da4fc12f119a9b, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:55:57,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 245a468c597d21bd747b336f9fe7855c, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:55:57,650 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure a60f818b223a39e20a92d5ad84ca38d8, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:55:57,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-02 21:55:57,667 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/.tmp/family1/027a740b08824594bf54ad9b854a7917 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/027a740b08824594bf54ad9b854a7917 2023-11-02 21:55:57,673 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c8c87357778eb61d30f523cb6ae1f5a8/family1 of c8c87357778eb61d30f523cb6ae1f5a8 into 027a740b08824594bf54ad9b854a7917(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:55:57,674 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:55:57,674 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1698962156425; duration=1sec 2023-11-02 21:55:57,674 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:55:57,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/68a71dab818348db84c642343dac0094, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba03dd1f02484a43a816001b5eaf0700, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ef6f8e8bd2f242d6bce0738da5d88a7c_SeqId_47_] to archive 2023-11-02 21:55:57,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:55:57,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/68a71dab818348db84c642343dac0094 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/68a71dab818348db84c642343dac0094 2023-11-02 21:55:57,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba03dd1f02484a43a816001b5eaf0700 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ba03dd1f02484a43a816001b5eaf0700 2023-11-02 21:55:57,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ef6f8e8bd2f242d6bce0738da5d88a7c_SeqId_47_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/family1/ef6f8e8bd2f242d6bce0738da5d88a7c_SeqId_47_ 2023-11-02 21:55:57,801 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:57,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:57,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a60f818b223a39e20a92d5ad84ca38d8, NAME => 'testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8.', STARTKEY => '', ENDKEY => '1'} 2023-11-02 21:55:57,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:55:57,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:57,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:55:57,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:55:57,810 INFO [StoreOpener-a60f818b223a39e20a92d5ad84ca38d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:55:57,812 DEBUG [StoreOpener-a60f818b223a39e20a92d5ad84ca38d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8/family1 2023-11-02 21:55:57,812 DEBUG [StoreOpener-a60f818b223a39e20a92d5ad84ca38d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8/family1 2023-11-02 21:55:57,813 INFO [StoreOpener-a60f818b223a39e20a92d5ad84ca38d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a60f818b223a39e20a92d5ad84ca38d8 columnFamilyName family1 2023-11-02 21:55:57,815 INFO [StoreOpener-a60f818b223a39e20a92d5ad84ca38d8-1] regionserver.HStore(310): Store=a60f818b223a39e20a92d5ad84ca38d8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:57,815 INFO [StoreOpener-a60f818b223a39e20a92d5ad84ca38d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:55:57,816 DEBUG [StoreOpener-a60f818b223a39e20a92d5ad84ca38d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8/family2 2023-11-02 21:55:57,816 DEBUG [StoreOpener-a60f818b223a39e20a92d5ad84ca38d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8/family2 2023-11-02 21:55:57,817 INFO [StoreOpener-a60f818b223a39e20a92d5ad84ca38d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a60f818b223a39e20a92d5ad84ca38d8 columnFamilyName family2 2023-11-02 21:55:57,818 INFO [StoreOpener-a60f818b223a39e20a92d5ad84ca38d8-1] regionserver.HStore(310): Store=a60f818b223a39e20a92d5ad84ca38d8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:57,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:55:57,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:55:57,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:55:57,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:55:57,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:55:57,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened a60f818b223a39e20a92d5ad84ca38d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66481472, jitterRate=-0.009348869323730469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:55:57,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for a60f818b223a39e20a92d5ad84ca38d8: 2023-11-02 21:55:57,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8., pid=33, masterSystemTime=1698962157801 2023-11-02 21:55:57,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:57,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:57,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:55:57,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2fbdea9497438f69e6da4fc12f119a9b, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b.', STARTKEY => '2', ENDKEY => ''} 2023-11-02 21:55:57,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:55:57,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:57,833 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a60f818b223a39e20a92d5ad84ca38d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:57,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:55:57,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:55:57,833 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698962157833"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962157833"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962157833"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962157833"}]},"ts":"1698962157833"} 2023-11-02 21:55:57,834 INFO [StoreOpener-2fbdea9497438f69e6da4fc12f119a9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:55:57,836 DEBUG [StoreOpener-2fbdea9497438f69e6da4fc12f119a9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1 2023-11-02 21:55:57,837 DEBUG [StoreOpener-2fbdea9497438f69e6da4fc12f119a9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1 2023-11-02 21:55:57,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=28 2023-11-02 21:55:57,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure a60f818b223a39e20a92d5ad84ca38d8, server=jenkins-hbase12.apache.org,33583,1698962105160 in 185 msec 2023-11-02 21:55:57,837 INFO [StoreOpener-2fbdea9497438f69e6da4fc12f119a9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fbdea9497438f69e6da4fc12f119a9b columnFamilyName family1 2023-11-02 21:55:57,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a60f818b223a39e20a92d5ad84ca38d8, ASSIGN in 353 msec 2023-11-02 21:55:57,838 INFO [StoreOpener-2fbdea9497438f69e6da4fc12f119a9b-1] regionserver.HStore(310): Store=2fbdea9497438f69e6da4fc12f119a9b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:57,839 INFO [StoreOpener-2fbdea9497438f69e6da4fc12f119a9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:55:57,840 DEBUG [StoreOpener-2fbdea9497438f69e6da4fc12f119a9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family2 2023-11-02 21:55:57,841 DEBUG [StoreOpener-2fbdea9497438f69e6da4fc12f119a9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family2 2023-11-02 21:55:57,841 INFO [StoreOpener-2fbdea9497438f69e6da4fc12f119a9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fbdea9497438f69e6da4fc12f119a9b columnFamilyName family2 2023-11-02 21:55:57,842 INFO [StoreOpener-2fbdea9497438f69e6da4fc12f119a9b-1] regionserver.HStore(310): Store=2fbdea9497438f69e6da4fc12f119a9b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:57,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:55:57,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:55:57,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:55:57,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:55:57,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:55:57,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 2fbdea9497438f69e6da4fc12f119a9b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59182798, jitterRate=-0.11810758709907532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:55:57,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 2fbdea9497438f69e6da4fc12f119a9b: 2023-11-02 21:55:57,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b., pid=31, masterSystemTime=1698962157801 2023-11-02 21:55:57,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:55:57,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:55:57,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:57,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 245a468c597d21bd747b336f9fe7855c, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c.', STARTKEY => '1', ENDKEY => '2'} 2023-11-02 21:55:57,851 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2fbdea9497438f69e6da4fc12f119a9b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:57,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 245a468c597d21bd747b336f9fe7855c 2023-11-02 21:55:57,852 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698962157851"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962157851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962157851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962157851"}]},"ts":"1698962157851"} 2023-11-02 21:55:57,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:55:57,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 245a468c597d21bd747b336f9fe7855c 2023-11-02 21:55:57,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 245a468c597d21bd747b336f9fe7855c 2023-11-02 21:55:57,853 INFO [StoreOpener-245a468c597d21bd747b336f9fe7855c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 245a468c597d21bd747b336f9fe7855c 2023-11-02 21:55:57,855 DEBUG [StoreOpener-245a468c597d21bd747b336f9fe7855c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c/family1 2023-11-02 21:55:57,855 DEBUG [StoreOpener-245a468c597d21bd747b336f9fe7855c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c/family1 2023-11-02 21:55:57,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=30 2023-11-02 21:55:57,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 2fbdea9497438f69e6da4fc12f119a9b, server=jenkins-hbase12.apache.org,33583,1698962105160 in 207 msec 2023-11-02 21:55:57,855 INFO [StoreOpener-245a468c597d21bd747b336f9fe7855c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 245a468c597d21bd747b336f9fe7855c columnFamilyName family1 2023-11-02 21:55:57,856 INFO [StoreOpener-245a468c597d21bd747b336f9fe7855c-1] regionserver.HStore(310): Store=245a468c597d21bd747b336f9fe7855c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:57,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2fbdea9497438f69e6da4fc12f119a9b, ASSIGN in 371 msec 2023-11-02 21:55:57,857 INFO [StoreOpener-245a468c597d21bd747b336f9fe7855c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 245a468c597d21bd747b336f9fe7855c 2023-11-02 21:55:57,858 DEBUG [StoreOpener-245a468c597d21bd747b336f9fe7855c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c/family2 2023-11-02 21:55:57,858 DEBUG [StoreOpener-245a468c597d21bd747b336f9fe7855c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c/family2 2023-11-02 21:55:57,858 INFO [StoreOpener-245a468c597d21bd747b336f9fe7855c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 245a468c597d21bd747b336f9fe7855c columnFamilyName family2 2023-11-02 21:55:57,859 INFO [StoreOpener-245a468c597d21bd747b336f9fe7855c-1] regionserver.HStore(310): Store=245a468c597d21bd747b336f9fe7855c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:55:57,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c 2023-11-02 21:55:57,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c 2023-11-02 21:55:57,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:55:57,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 245a468c597d21bd747b336f9fe7855c 2023-11-02 21:55:57,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:55:57,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 245a468c597d21bd747b336f9fe7855c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74329581, jitterRate=0.10759706795215607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:55:57,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 245a468c597d21bd747b336f9fe7855c: 2023-11-02 21:55:57,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c., pid=32, masterSystemTime=1698962157801 2023-11-02 21:55:57,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:57,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:57,868 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=245a468c597d21bd747b336f9fe7855c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:57,868 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698962157868"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962157868"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962157868"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962157868"}]},"ts":"1698962157868"} 2023-11-02 21:55:57,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=29 2023-11-02 21:55:57,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 245a468c597d21bd747b336f9fe7855c, server=jenkins-hbase12.apache.org,33583,1698962105160 in 222 msec 2023-11-02 21:55:57,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-11-02 21:55:57,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=245a468c597d21bd747b336f9fe7855c, ASSIGN in 388 msec 2023-11-02 21:55:57,874 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:55:57,874 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962157874"}]},"ts":"1698962157874"} 2023-11-02 21:55:57,875 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-02 21:55:57,928 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:55:57,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.3750 sec 2023-11-02 21:55:58,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-02 21:55:58,665 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-02 21:55:58,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:58,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:58,679 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-02 21:55:58,680 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:58,680 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-02 21:55:58,680 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-02 21:55:58,680 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:58,680 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:58,747 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:58,747 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:58,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:58,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:58,749 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:58,749 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:58,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:58,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:58,752 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:58,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:58,753 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-02 21:55:58,753 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:58,753 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-02 21:55:58,753 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:58,754 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. started... 2023-11-02 21:55:58,754 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:55:58,754 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:58,755 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. started... 2023-11-02 21:55:58,755 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a60f818b223a39e20a92d5ad84ca38d8: 2023-11-02 21:55:58,755 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:55:58,755 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:58,756 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. started... 2023-11-02 21:55:58,756 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 245a468c597d21bd747b336f9fe7855c: 2023-11-02 21:55:58,757 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2fbdea9497438f69e6da4fc12f119a9b 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-02 21:55:58,756 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:58,757 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:58,758 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:55:58,758 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:55:59,200 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:55:59,200 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7359405b to 127.0.0.1:49550 2023-11-02 21:55:59,200 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:55:59,202 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:55:59,202 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311024f7acc6c0497401eb7b7cd7813d2a316 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311024f7acc6c0497401eb7b7cd7813d2a316 2023-11-02 21:55:59,202 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b1e1462 to 127.0.0.1:49550 2023-11-02 21:55:59,202 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:55:59,202 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:55:59,202 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56ed9fae to 127.0.0.1:49550 2023-11-02 21:55:59,203 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:55:59,203 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:55:59,203 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46f4dcbf to 127.0.0.1:49550 2023-11-02 21:55:59,203 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:55:59,615 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/.tmp/family1/b4a62ea7dee64d78974e831f967151f2 2023-11-02 21:55:59,627 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/.tmp/family1/b4a62ea7dee64d78974e831f967151f2 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/b4a62ea7dee64d78974e831f967151f2 2023-11-02 21:55:59,633 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/b4a62ea7dee64d78974e831f967151f2, entries=1, sequenceid=5, filesize=4.9 K 2023-11-02 21:55:59,634 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 2fbdea9497438f69e6da4fc12f119a9b in 877ms, sequenceid=5, compaction requested=false 2023-11-02 21:55:59,634 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-02 21:55:59,634 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2fbdea9497438f69e6da4fc12f119a9b: 2023-11-02 21:55:59,635 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:55:59,635 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:55:59,635 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:55:59,635 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,635 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-02 21:55:59,635 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-02 21:55:59,652 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,652 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:59,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:59,653 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,653 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:55:59,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:59,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:59,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:59,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-02 21:55:59,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73e70038[Count = 0] remaining members to acquire global barrier 2023-11-02 21:55:59,656 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-02 21:55:59,656 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,663 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,663 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-02 21:55:59,663 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-02 21:55:59,663 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:55:59,663 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,663 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:55:59,673 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-02 21:55:59,674 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,674 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:59,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:59,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:59,674 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-02 21:55:59,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:59,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:59,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:59,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:55:59,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-02 21:55:59,681 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-02 21:55:59,681 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:55:59,681 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:55:59,681 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,681 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:55:59,695 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,695 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,695 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:59,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:55:59,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:55:59,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:59,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:59,696 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:55:59,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:55:59,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,700 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:55:59,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,715 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,716 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,716 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,716 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-02 21:55:59,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:55:59,715 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:59,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-02 21:55:59,716 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,716 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,716 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,716 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:55:59,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:59,716 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:55:59,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:59,716 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-02 21:55:59,716 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:55:59,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:55:59,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:55:59,817 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:55:59,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:55:59,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:55:59,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-02 21:55:59,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,831 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-02 21:55:59,831 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:59,831 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-02 21:55:59,831 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-02 21:55:59,832 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,832 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,842 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:55:59,842 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:55:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:55:59,842 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:55:59,842 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:55:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:55:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,843 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,843 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-02 21:55:59,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-02 21:55:59,843 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-02 21:55:59,843 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:55:59,843 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-02 21:55:59,844 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:59,844 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. started... 2023-11-02 21:55:59,844 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a60f818b223a39e20a92d5ad84ca38d8: 2023-11-02 21:55:59,844 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:55:59,844 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:59,844 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. started... 2023-11-02 21:55:59,844 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 245a468c597d21bd747b336f9fe7855c: 2023-11-02 21:55:59,844 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:55:59,845 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:55:59,845 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:55:59,845 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:55:59,845 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. started... 2023-11-02 21:55:59,845 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:55:59,845 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:55:59,846 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2fbdea9497438f69e6da4fc12f119a9b 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-02 21:56:00,266 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102b903439200214fbe9e3e2fe4454abaff to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231102b903439200214fbe9e3e2fe4454abaff 2023-11-02 21:56:00,275 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/.tmp/family1/2cb6b71373ac4102beb63badce32449e 2023-11-02 21:56:00,282 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/.tmp/family1/2cb6b71373ac4102beb63badce32449e as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/2cb6b71373ac4102beb63badce32449e 2023-11-02 21:56:00,286 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/2cb6b71373ac4102beb63badce32449e, entries=2, sequenceid=9, filesize=5.0 K 2023-11-02 21:56:00,287 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 2fbdea9497438f69e6da4fc12f119a9b in 442ms, sequenceid=9, compaction requested=false 2023-11-02 21:56:00,287 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2fbdea9497438f69e6da4fc12f119a9b: 2023-11-02 21:56:00,287 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:56:00,287 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:56:00,287 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:56:00,287 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,287 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-02 21:56:00,287 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-02 21:56:00,387 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,387 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:00,388 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,388 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:00,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:00,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:00,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-02 21:56:00,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c93547f[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:00,391 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-02 21:56:00,391 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,452 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,453 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-02 21:56:00,453 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-02 21:56:00,453 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:00,453 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,453 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:00,492 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,492 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-02 21:56:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:00,492 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:00,492 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-02 21:56:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:00,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:00,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:00,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-02 21:56:00,494 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-02 21:56:00,494 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:00,494 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:00,494 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,494 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:00,515 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,515 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:00,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,516 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:00,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:00,517 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:00,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:00,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,523 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:00,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,536 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,536 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,536 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:00,537 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,537 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:00,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-02 21:56:00,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:00,537 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:00,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:00,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:00,537 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:00,537 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:00,537 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:00,537 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,537 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,537 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:00,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:00,637 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:00,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:00,656 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-02 21:56:00,658 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-02 21:56:00,659 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-02 21:56:00,660 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:00,660 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962760660 2023-11-02 21:56:00,661 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:56:00,661 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-02 21:56:00,661 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-02 21:56:00,663 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x3aa5bfdf to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:56:00,674 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3492c12d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:56:00,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231102 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-02 21:56:01,522 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311023acf263d66dc48079317c929e185e320 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311023acf263d66dc48079317c929e185e320 2023-11-02 21:56:01,523 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231102 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-02 21:56:01,537 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:56:01,539 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:55286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:56:01,546 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:56:01,548 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:49984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:56:01,559 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231102/family1/df6a5e529d4b4e87a89be5ead7de7067 first=Optional[k0] last=Optional[k1] 2023-11-02 21:56:01,560 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231102/family1/df6a5e529d4b4e87a89be5ead7de7067}] 2023-11-02 21:56:01,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231102/family1/df6a5e529d4b4e87a89be5ead7de7067 for inclusion in 2fbdea9497438f69e6da4fc12f119a9b/family1 2023-11-02 21:56:01,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-02 21:56:01,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-02 21:56:01,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 2fbdea9497438f69e6da4fc12f119a9b: 2023-11-02 21:56:01,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231102/family1/df6a5e529d4b4e87a89be5ead7de7067 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testScannerOnBulkLoadRefHFiles__n4amkjj2skfm40mhs4sr7mc1lnrusg7j8mgamopnbol33uqocekc0duosc896vgg/family1/df6a5e529d4b4e87a89be5ead7de7067 2023-11-02 21:56:01,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testScannerOnBulkLoadRefHFiles__n4amkjj2skfm40mhs4sr7mc1lnrusg7j8mgamopnbol33uqocekc0duosc896vgg/family1/df6a5e529d4b4e87a89be5ead7de7067 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/e24646f1f32743d4a4295595a7cb4a95_SeqId_12_ 2023-11-02 21:56:01,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testScannerOnBulkLoadRefHFiles__n4amkjj2skfm40mhs4sr7mc1lnrusg7j8mgamopnbol33uqocekc0duosc896vgg/family1/df6a5e529d4b4e87a89be5ead7de7067 into 2fbdea9497438f69e6da4fc12f119a9b/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/e24646f1f32743d4a4295595a7cb4a95_SeqId_12_ - updating store file list. 2023-11-02 21:56:01,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/e24646f1f32743d4a4295595a7cb4a95_SeqId_12_ into 2fbdea9497438f69e6da4fc12f119a9b/family1 2023-11-02 21:56:01,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testScannerOnBulkLoadRefHFiles__n4amkjj2skfm40mhs4sr7mc1lnrusg7j8mgamopnbol33uqocekc0duosc896vgg/family1/df6a5e529d4b4e87a89be5ead7de7067 into 2fbdea9497438f69e6da4fc12f119a9b/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/e24646f1f32743d4a4295595a7cb4a95_SeqId_12_) 2023-11-02 21:56:01,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testScannerOnBulkLoadRefHFiles__n4amkjj2skfm40mhs4sr7mc1lnrusg7j8mgamopnbol33uqocekc0duosc896vgg/family1/df6a5e529d4b4e87a89be5ead7de7067 2023-11-02 21:56:01,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-02 21:56:01,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-02 21:56:01,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 2fbdea9497438f69e6da4fc12f119a9b/family1 is initiating minor compaction (all files) 2023-11-02 21:56:01,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1ad701d8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:01,579 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2fbdea9497438f69e6da4fc12f119a9b/family1 in testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:56:01,579 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/b4a62ea7dee64d78974e831f967151f2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/2cb6b71373ac4102beb63badce32449e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/e24646f1f32743d4a4295595a7cb4a95_SeqId_12_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/.tmp, totalSize=15.1 K 2023-11-02 21:56:01,580 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting b4a62ea7dee64d78974e831f967151f2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962158666 2023-11-02 21:56:01,581 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 2cb6b71373ac4102beb63badce32449e, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962158666 2023-11-02 21:56:01,581 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting e24646f1f32743d4a4295595a7cb4a95_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962158666 2023-11-02 21:56:01,582 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231102 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-02 21:56:01,583 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:01,584 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311024f7acc6c0497401eb7b7cd7813d2a316 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311024f7acc6c0497401eb7b7cd7813d2a316 2023-11-02 21:56:01,585 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231102b903439200214fbe9e3e2fe4454abaff to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231102b903439200214fbe9e3e2fe4454abaff 2023-11-02 21:56:01,585 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-02 21:56:01,585 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231102' 2023-11-02 21:56:01,586 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231102 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-02 21:56:01,586 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-02 21:56:01,586 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:01,587 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-02 21:56:01,588 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 930 msec 2023-11-02 21:56:01,592 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2fbdea9497438f69e6da4fc12f119a9b#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:56:01,621 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=248 (was 261), OpenFileDescriptor=612 (was 644), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 211), ProcessCount=174 (was 174), AvailableMemoryMB=482 (was 536) 2023-11-02 21:56:01,632 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=248, OpenFileDescriptor=612, MaxFileDescriptor=60000, SystemLoadAverage=210, ProcessCount=174, AvailableMemoryMB=482 2023-11-02 21:56:01,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-02 21:56:01,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:01,637 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:56:01,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-02 21:56:01,638 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:56:01,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-02 21:56:01,639 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6 2023-11-02 21:56:01,640 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6 empty. 2023-11-02 21:56:01,640 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6 2023-11-02 21:56:01,640 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-02 21:56:01,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-02 21:56:01,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-02 21:56:02,050 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-02 21:56:02,052 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => cf901ed3d958e22b4fac1a5a9cd0edc6, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:56:02,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-02 21:56:02,458 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:02,458 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing cf901ed3d958e22b4fac1a5a9cd0edc6, disabling compactions & flushes 2023-11-02 21:56:02,458 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:02,458 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:02,458 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. after waiting 0 ms 2023-11-02 21:56:02,458 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:02,458 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:02,459 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:02,463 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:56:02,465 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698962162465"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962162465"}]},"ts":"1698962162465"} 2023-11-02 21:56:02,468 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-02 21:56:02,469 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:56:02,470 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962162470"}]},"ts":"1698962162470"} 2023-11-02 21:56:02,472 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-02 21:56:02,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=cf901ed3d958e22b4fac1a5a9cd0edc6, ASSIGN}] 2023-11-02 21:56:02,561 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=cf901ed3d958e22b4fac1a5a9cd0edc6, ASSIGN 2023-11-02 21:56:02,562 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=cf901ed3d958e22b4fac1a5a9cd0edc6, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:56:02,714 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=cf901ed3d958e22b4fac1a5a9cd0edc6, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:02,715 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698962162714"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962162714"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962162714"}]},"ts":"1698962162714"} 2023-11-02 21:56:02,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure cf901ed3d958e22b4fac1a5a9cd0edc6, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:02,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-02 21:56:02,822 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/.tmp/family1/45f0a99f16364c2f9dad82e2be7cc0e9 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/45f0a99f16364c2f9dad82e2be7cc0e9 2023-11-02 21:56:02,828 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2fbdea9497438f69e6da4fc12f119a9b/family1 of 2fbdea9497438f69e6da4fc12f119a9b into 45f0a99f16364c2f9dad82e2be7cc0e9(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:56:02,828 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2fbdea9497438f69e6da4fc12f119a9b: 2023-11-02 21:56:02,828 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1698962161579; duration=1sec 2023-11-02 21:56:02,828 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:02,874 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:02,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:02,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf901ed3d958e22b4fac1a5a9cd0edc6, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:56:02,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy cf901ed3d958e22b4fac1a5a9cd0edc6 2023-11-02 21:56:02,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:02,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for cf901ed3d958e22b4fac1a5a9cd0edc6 2023-11-02 21:56:02,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for cf901ed3d958e22b4fac1a5a9cd0edc6 2023-11-02 21:56:02,880 INFO [StoreOpener-cf901ed3d958e22b4fac1a5a9cd0edc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cf901ed3d958e22b4fac1a5a9cd0edc6 2023-11-02 21:56:02,882 DEBUG [StoreOpener-cf901ed3d958e22b4fac1a5a9cd0edc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1 2023-11-02 21:56:02,882 DEBUG [StoreOpener-cf901ed3d958e22b4fac1a5a9cd0edc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1 2023-11-02 21:56:02,883 INFO [StoreOpener-cf901ed3d958e22b4fac1a5a9cd0edc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf901ed3d958e22b4fac1a5a9cd0edc6 columnFamilyName family1 2023-11-02 21:56:02,885 INFO [StoreOpener-cf901ed3d958e22b4fac1a5a9cd0edc6-1] regionserver.HStore(310): Store=cf901ed3d958e22b4fac1a5a9cd0edc6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:02,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6 2023-11-02 21:56:02,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6 2023-11-02 21:56:02,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for cf901ed3d958e22b4fac1a5a9cd0edc6 2023-11-02 21:56:02,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:56:02,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened cf901ed3d958e22b4fac1a5a9cd0edc6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70754653, jitterRate=0.05432648956775665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:56:02,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:02,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6., pid=37, masterSystemTime=1698962162874 2023-11-02 21:56:02,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:02,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:02,895 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=cf901ed3d958e22b4fac1a5a9cd0edc6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:02,895 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698962162895"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962162895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962162895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962162895"}]},"ts":"1698962162895"} 2023-11-02 21:56:02,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-02 21:56:02,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure cf901ed3d958e22b4fac1a5a9cd0edc6, server=jenkins-hbase12.apache.org,33583,1698962105160 in 178 msec 2023-11-02 21:56:02,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-02 21:56:02,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=cf901ed3d958e22b4fac1a5a9cd0edc6, ASSIGN in 340 msec 2023-11-02 21:56:02,900 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:56:02,900 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962162900"}]},"ts":"1698962162900"} 2023-11-02 21:56:02,901 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-02 21:56:02,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/b4a62ea7dee64d78974e831f967151f2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/2cb6b71373ac4102beb63badce32449e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/e24646f1f32743d4a4295595a7cb4a95_SeqId_12_] to archive 2023-11-02 21:56:02,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:02,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/b4a62ea7dee64d78974e831f967151f2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/b4a62ea7dee64d78974e831f967151f2 2023-11-02 21:56:02,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/2cb6b71373ac4102beb63badce32449e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/2cb6b71373ac4102beb63badce32449e 2023-11-02 21:56:02,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/e24646f1f32743d4a4295595a7cb4a95_SeqId_12_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/family1/e24646f1f32743d4a4295595a7cb4a95_SeqId_12_ 2023-11-02 21:56:02,969 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:56:02,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.3340 sec 2023-11-02 21:56:03,343 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:56:03,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-02 21:56:03,749 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-02 21:56:03,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:03,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:03,781 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:03,781 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:03,781 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:56:03,781 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:56:03,782 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:03,782 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:03,852 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:03,852 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:03,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:03,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:03,854 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:03,854 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:03,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:03,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:03,856 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:03,857 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:03,857 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:56:03,857 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:03,857 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:56:03,857 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:03,858 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:03,858 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:03,858 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. started... 2023-11-02 21:56:03,859 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf901ed3d958e22b4fac1a5a9cd0edc6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-02 21:56:04,291 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130898f552a4fd44f4baad7e9a662ab7611 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130898f552a4fd44f4baad7e9a662ab7611 2023-11-02 21:56:04,696 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/a315359adcc74193b273439c49445297 2023-11-02 21:56:04,703 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/a315359adcc74193b273439c49445297 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a315359adcc74193b273439c49445297 2023-11-02 21:56:04,709 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a315359adcc74193b273439c49445297, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-02 21:56:04,711 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for cf901ed3d958e22b4fac1a5a9cd0edc6 in 851ms, sequenceid=5, compaction requested=false 2023-11-02 21:56:04,711 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:04,711 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:04,711 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:04,712 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:04,712 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:04,712 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,712 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:56:04,712 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:56:04,779 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,779 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:04,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:04,779 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:04,779 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:04,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:04,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:04,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:56:04,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3294161d[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:04,781 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:56:04,781 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,789 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,789 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:56:04,789 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:56:04,789 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:04,789 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,789 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:04,799 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,799 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:56:04,799 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:04,799 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:56:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:04,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:04,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:56:04,804 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:56:04,804 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:04,804 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:04,804 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,804 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:04,817 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,817 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,817 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:04,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:04,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:04,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:04,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:04,818 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:04,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:04,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,821 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,831 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,831 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,831 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,831 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,831 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,831 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:04,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:04,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:04,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:04,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:04,831 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:04,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-02 21:56:04,832 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:04,831 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:04,831 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:04,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:04,832 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,832 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:04,932 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:04,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:04,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:04,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:04,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,945 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:04,945 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:04,945 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:56:04,945 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:56:04,946 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,946 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,957 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:04,957 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:04,958 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:04,959 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:04,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,961 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,962 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:56:04,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:04,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:56:04,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:04,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:56:04,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:04,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:04,963 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:04,963 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. started... 2023-11-02 21:56:04,963 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf901ed3d958e22b4fac1a5a9cd0edc6 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-02 21:56:05,386 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ca9d8b50c1f84e7f8527057b04758be9 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128ca9d8b50c1f84e7f8527057b04758be9 2023-11-02 21:56:05,795 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/98b7703b450949bea1c65b497b9566a2 2023-11-02 21:56:05,830 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/98b7703b450949bea1c65b497b9566a2 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/98b7703b450949bea1c65b497b9566a2 2023-11-02 21:56:05,838 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/98b7703b450949bea1c65b497b9566a2, entries=1, sequenceid=9, filesize=5.0 K 2023-11-02 21:56:05,839 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for cf901ed3d958e22b4fac1a5a9cd0edc6 in 876ms, sequenceid=9, compaction requested=false 2023-11-02 21:56:05,839 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:05,839 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:05,839 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:05,839 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:05,839 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,839 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:56:05,839 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:56:05,870 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,870 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:05,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:05,871 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,871 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:05,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:05,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:05,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:05,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:56:05,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@308b1e9b[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:05,876 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:56:05,876 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,884 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,884 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:56:05,884 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:56:05,884 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:05,884 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,885 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:05,894 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:56:05,894 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:05,894 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:56:05,894 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:05,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:05,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:05,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:05,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:05,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:56:05,896 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:56:05,896 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:05,896 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:05,896 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,896 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:05,904 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,904 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:05,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,904 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:05,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:05,905 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:05,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,906 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:05,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,945 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:05,945 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,946 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:05,946 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:05,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:05,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:05,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:05,946 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,946 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,946 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:05,946 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:05,946 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:05,946 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:05,946 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,947 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:05,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:05,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:06,047 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:06,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:06,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:06,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:06,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:06,060 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:06,061 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:06,061 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:56:06,061 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:56:06,062 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:06,062 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:06,084 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:06,084 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:06,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:06,085 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:06,085 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:06,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:06,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:06,087 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:06,087 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:56:06,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:06,088 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:56:06,088 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:06,088 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:56:06,088 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:06,088 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:06,088 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:06,088 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. started... 2023-11-02 21:56:06,088 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf901ed3d958e22b4fac1a5a9cd0edc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:06,507 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011e4014682b614967bba6d0369eebfd43 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011e4014682b614967bba6d0369eebfd43 2023-11-02 21:56:06,916 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/60f15bd80e694955ba05d5a880d5b051 2023-11-02 21:56:06,928 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/60f15bd80e694955ba05d5a880d5b051 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/60f15bd80e694955ba05d5a880d5b051 2023-11-02 21:56:06,937 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/60f15bd80e694955ba05d5a880d5b051, entries=1, sequenceid=13, filesize=4.9 K 2023-11-02 21:56:06,938 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf901ed3d958e22b4fac1a5a9cd0edc6 in 850ms, sequenceid=13, compaction requested=true 2023-11-02 21:56:06,938 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:06,938 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:06,938 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:06,938 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:06,938 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:06,938 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:56:06,938 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:56:06,999 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:06,999 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:07,000 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,001 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:07,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:07,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:56:07,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b263e72[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:07,006 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:56:07,006 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,017 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,017 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:56:07,017 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:56:07,017 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:07,018 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,018 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:07,031 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:56:07,031 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:07,031 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:56:07,031 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:07,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:56:07,042 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:56:07,042 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:07,042 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:07,042 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,042 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:07,052 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,052 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:07,052 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:07,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:07,053 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,054 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:07,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,062 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,062 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,062 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:07,062 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:07,063 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:07,063 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:07,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:07,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:07,063 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,063 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,063 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,063 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,063 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:07,064 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:07,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:07,164 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:07,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:07,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:07,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:07,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,170 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:07,170 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:07,170 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:56:07,170 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:56:07,171 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,171 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,239 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,239 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:07,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:07,262 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:07,262 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:07,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:07,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,264 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:56:07,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:07,264 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:56:07,264 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:07,264 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:56:07,264 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:07,264 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:07,264 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:07,265 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. started... 2023-11-02 21:56:07,265 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf901ed3d958e22b4fac1a5a9cd0edc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:07,690 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058a4a66d3efbf4bcb9a992ca57b78d005 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512058a4a66d3efbf4bcb9a992ca57b78d005 2023-11-02 21:56:08,100 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/f4401ebe91fb4ac0b3159c6e608cbba8 2023-11-02 21:56:08,113 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/f4401ebe91fb4ac0b3159c6e608cbba8 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/f4401ebe91fb4ac0b3159c6e608cbba8 2023-11-02 21:56:08,122 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/f4401ebe91fb4ac0b3159c6e608cbba8, entries=1, sequenceid=17, filesize=4.9 K 2023-11-02 21:56:08,124 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf901ed3d958e22b4fac1a5a9cd0edc6 in 859ms, sequenceid=17, compaction requested=true 2023-11-02 21:56:08,124 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:08,124 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:08,124 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:08,124 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:08,124 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,124 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:56:08,124 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:56:08,221 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,221 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:08,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:08,223 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,223 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:08,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:08,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:08,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:08,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:56:08,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d30adc5[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:08,230 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:56:08,230 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,241 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,241 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:56:08,241 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:56:08,241 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:08,241 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,242 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:08,252 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:56:08,252 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:08,252 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:56:08,252 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:08,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:08,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:56:08,255 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:56:08,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:08,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:08,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,255 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:08,262 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,262 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,262 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:08,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:08,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:08,263 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:08,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:08,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,265 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:08,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:08,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:08,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,280 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:08,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:08,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:08,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:08,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:08,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,281 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:08,281 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:08,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:08,381 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:08,382 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:56:08,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:08,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:08,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:08,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,392 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:08,392 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:08,392 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:56:08,392 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:56:08,393 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,393 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,399 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:08,399 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:08,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:08,399 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:08,399 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,400 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,400 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:56:08,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:08,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:56:08,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:08,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:56:08,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:08,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:08,401 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:08,401 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. started... 2023-11-02 21:56:08,402 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf901ed3d958e22b4fac1a5a9cd0edc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:08,821 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c1919dd6e0214385981431d581ed22f1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c1919dd6e0214385981431d581ed22f1 2023-11-02 21:56:09,228 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/af6d0497be0440d39158979937510dd8 2023-11-02 21:56:09,240 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/af6d0497be0440d39158979937510dd8 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/af6d0497be0440d39158979937510dd8 2023-11-02 21:56:09,246 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/af6d0497be0440d39158979937510dd8, entries=1, sequenceid=21, filesize=4.9 K 2023-11-02 21:56:09,247 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf901ed3d958e22b4fac1a5a9cd0edc6 in 845ms, sequenceid=21, compaction requested=true 2023-11-02 21:56:09,247 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:09,248 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:09,248 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:09,248 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:09,248 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,248 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:56:09,248 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:56:09,305 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,305 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:09,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:09,306 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,306 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:09,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:09,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:09,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:09,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:56:09,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f067c80[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:09,311 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:56:09,311 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,322 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,322 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:56:09,322 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:56:09,322 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:09,322 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,322 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:09,357 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:56:09,357 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:09,357 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:56:09,357 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:09,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:09,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:56:09,360 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:56:09,360 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:09,360 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:09,360 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,360 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:09,378 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,378 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:09,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:09,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,378 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:09,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:09,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:09,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:09,379 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:09,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,380 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:09,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,388 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,389 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:09,389 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,389 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:09,389 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:09,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-02 21:56:09,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:09,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:09,389 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,389 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,389 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,389 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,389 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:09,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:09,389 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:09,390 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:09,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:09,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:09,490 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:09,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:09,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:09,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:09,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,504 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:09,505 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:09,505 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:56:09,505 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:56:09,506 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,506 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,515 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,515 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:09,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:09,516 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,516 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:09,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,519 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,519 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:56:09,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:09,520 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:56:09,520 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:09,520 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:56:09,520 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:09,520 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:09,521 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:09,521 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. started... 2023-11-02 21:56:09,521 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf901ed3d958e22b4fac1a5a9cd0edc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:09,537 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314c5bf65549c344ed8c3948c43a8b1be8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512314c5bf65549c344ed8c3948c43a8b1be8 2023-11-02 21:56:09,943 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/3f7bfccf5c8242aaa859560ac385f63c 2023-11-02 21:56:09,957 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/3f7bfccf5c8242aaa859560ac385f63c as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/3f7bfccf5c8242aaa859560ac385f63c 2023-11-02 21:56:09,964 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/3f7bfccf5c8242aaa859560ac385f63c, entries=1, sequenceid=25, filesize=4.9 K 2023-11-02 21:56:09,965 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf901ed3d958e22b4fac1a5a9cd0edc6 in 444ms, sequenceid=25, compaction requested=true 2023-11-02 21:56:09,965 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:09,965 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:09,965 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:09,965 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:09,965 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:09,965 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:56:09,965 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:56:10,009 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,010 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:10,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:10,010 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,010 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:10,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:10,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:10,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:10,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:56:10,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2711cc3d[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:10,015 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:56:10,016 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,027 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,028 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:56:10,028 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:56:10,028 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:10,028 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,028 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:10,041 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:56:10,042 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,042 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:10,042 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:56:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:10,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:56:10,054 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:56:10,054 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:10,054 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:10,055 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,055 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:10,069 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,069 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:10,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,069 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:10,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:10,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:10,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:10,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:10,070 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:10,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,072 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:10,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,083 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,083 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,083 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,083 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:10,083 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:10,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:10,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:10,083 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,084 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,084 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,084 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:10,084 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:10,084 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:10,084 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:10,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:10,184 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:10,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:10,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:10,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:10,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,191 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:10,191 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:10,191 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:56:10,191 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:56:10,191 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,192 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,199 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:10,199 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:10,199 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:10,199 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:10,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:10,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,200 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,201 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:56:10,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:10,201 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:56:10,201 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:10,201 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:56:10,201 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:10,201 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:10,201 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:10,201 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. started... 2023-11-02 21:56:10,201 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf901ed3d958e22b4fac1a5a9cd0edc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:10,618 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101fd3bd82b17d94c66811879920ddb3ade to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101fd3bd82b17d94c66811879920ddb3ade 2023-11-02 21:56:11,025 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/5fce2fc398d04d2eae063257991e8bb9 2023-11-02 21:56:11,037 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/5fce2fc398d04d2eae063257991e8bb9 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/5fce2fc398d04d2eae063257991e8bb9 2023-11-02 21:56:11,045 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/5fce2fc398d04d2eae063257991e8bb9, entries=1, sequenceid=29, filesize=4.9 K 2023-11-02 21:56:11,046 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf901ed3d958e22b4fac1a5a9cd0edc6 in 845ms, sequenceid=29, compaction requested=true 2023-11-02 21:56:11,046 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:11,046 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:11,046 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:11,046 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:11,046 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,046 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:56:11,046 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:56:11,094 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,094 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:11,094 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,094 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:11,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:56:11,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d8eb303[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:11,098 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:56:11,099 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,112 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:56:11,112 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:56:11,112 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:11,112 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,112 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:11,125 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:56:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:11,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:11,126 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:56:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:11,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:11,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:11,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:11,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:56:11,134 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:56:11,134 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:11,134 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:11,134 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,134 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:11,146 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,146 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,146 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:11,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:11,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:11,148 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:11,153 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:11,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,167 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,167 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:11,167 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:11,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:11,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:11,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:11,167 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:11,167 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-02 21:56:11,167 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:11,168 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,168 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:11,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:11,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:11,168 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,168 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:11,168 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,168 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,268 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:11,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:11,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:11,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:11,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,276 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:11,276 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:11,276 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:56:11,276 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:56:11,276 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,276 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,315 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,315 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:11,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:11,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:11,316 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:11,316 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:11,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:11,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,317 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:56:11,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:11,318 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:56:11,318 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:11,318 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:56:11,318 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:11,318 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:11,318 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:11,318 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. started... 2023-11-02 21:56:11,318 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf901ed3d958e22b4fac1a5a9cd0edc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:11,743 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a1f2acd05be844fc98259cd1942e4256 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1f2acd05be844fc98259cd1942e4256 2023-11-02 21:56:12,151 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/a946c2ed7d4944cb83360b3483fffaad 2023-11-02 21:56:12,160 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/a946c2ed7d4944cb83360b3483fffaad as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a946c2ed7d4944cb83360b3483fffaad 2023-11-02 21:56:12,168 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a946c2ed7d4944cb83360b3483fffaad, entries=1, sequenceid=33, filesize=4.9 K 2023-11-02 21:56:12,169 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf901ed3d958e22b4fac1a5a9cd0edc6 in 851ms, sequenceid=33, compaction requested=true 2023-11-02 21:56:12,169 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:12,169 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:12,169 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:12,169 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:12,170 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,170 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:56:12,170 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:56:12,262 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,262 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:12,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:12,263 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,263 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:12,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:12,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:56:12,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@350865f2[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:12,267 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:56:12,267 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,280 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:56:12,280 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:56:12,280 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:12,281 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,281 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:12,294 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,294 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:56:12,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:12,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:12,294 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:12,295 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:56:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:12,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:12,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:12,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:56:12,305 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:56:12,305 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:12,305 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:12,305 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,305 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:12,347 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,347 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,347 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:12,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:12,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:12,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:12,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:12,350 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:12,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:12,354 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,367 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,367 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:12,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:12,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:12,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:12,367 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:12,367 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:12,367 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:12,368 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:12,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-02 21:56:12,368 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,368 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:12,368 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,368 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:12,368 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:12,368 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,468 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:12,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:12,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:12,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:12,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,478 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:12,478 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:12,478 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:56:12,478 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:56:12,479 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,479 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,490 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:12,490 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:12,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:12,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,491 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:12,492 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:12,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,493 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,494 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:56:12,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:12,494 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:56:12,494 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:12,494 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:56:12,495 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:12,495 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:12,495 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:12,495 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. started... 2023-11-02 21:56:12,495 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf901ed3d958e22b4fac1a5a9cd0edc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:12,916 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074640ae54fe4c4142885672050ef4be3f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509074640ae54fe4c4142885672050ef4be3f 2023-11-02 21:56:13,324 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/ea31f61e7b6f4c22b9331c12cbcc9b6c 2023-11-02 21:56:13,333 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/ea31f61e7b6f4c22b9331c12cbcc9b6c as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/ea31f61e7b6f4c22b9331c12cbcc9b6c 2023-11-02 21:56:13,341 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/ea31f61e7b6f4c22b9331c12cbcc9b6c, entries=1, sequenceid=37, filesize=4.9 K 2023-11-02 21:56:13,341 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf901ed3d958e22b4fac1a5a9cd0edc6 in 846ms, sequenceid=37, compaction requested=true 2023-11-02 21:56:13,342 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:13,342 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:13,342 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:13,342 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:13,342 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,342 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:56:13,342 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:56:13,410 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,410 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:13,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:13,411 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,411 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:13,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:13,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:13,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:13,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:56:13,417 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:56:13,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4996edaf[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:13,417 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,430 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,431 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:56:13,431 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:56:13,431 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:13,431 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,431 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:13,441 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,441 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:56:13,441 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:13,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:13,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:13,441 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:56:13,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:13,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:13,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:13,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:13,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:56:13,450 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:56:13,450 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:13,450 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:13,450 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,450 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:13,462 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,462 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,462 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:13,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:13,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:13,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:13,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:13,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:13,463 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:13,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,464 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,472 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,472 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,473 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,473 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,473 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,473 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:13,473 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:13,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:13,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:13,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:13,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:13,473 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:13,473 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,473 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,474 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:13,474 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:13,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:13,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:13,574 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:13,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:13,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:13,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:13,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,582 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:13,582 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:13,582 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-02 21:56:13,582 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-02 21:56:13,583 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,583 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,595 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,595 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:13,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:13,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:13,596 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:13,596 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:13,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,598 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,598 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-02 21:56:13,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:13,598 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-02 21:56:13,598 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:13,599 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-02 21:56:13,599 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:13,599 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:13,599 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:13,599 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. started... 2023-11-02 21:56:13,599 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cf901ed3d958e22b4fac1a5a9cd0edc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:14,019 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112035fd96ab7f0c459fb722e811e0e3cb55 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112035fd96ab7f0c459fb722e811e0e3cb55 2023-11-02 21:56:14,427 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/0296a85045b54e1f9b997c6331c44d64 2023-11-02 21:56:14,439 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/0296a85045b54e1f9b997c6331c44d64 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/0296a85045b54e1f9b997c6331c44d64 2023-11-02 21:56:14,446 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/0296a85045b54e1f9b997c6331c44d64, entries=1, sequenceid=41, filesize=4.9 K 2023-11-02 21:56:14,447 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf901ed3d958e22b4fac1a5a9cd0edc6 in 848ms, sequenceid=41, compaction requested=true 2023-11-02 21:56:14,447 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:14,447 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:14,447 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:14,447 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:14,447 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,447 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-02 21:56:14,447 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-02 21:56:14,514 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,514 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:14,515 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,515 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:14,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-02 21:56:14,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@604fa084[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:14,518 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-02 21:56:14,518 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,525 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,525 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-02 21:56:14,525 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-02 21:56:14,525 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:14,525 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,526 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:14,535 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,536 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-02 21:56:14,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:14,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:14,536 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:14,536 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-02 21:56:14,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:14,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:14,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:14,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:56:14,543 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-02 21:56:14,543 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:14,543 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:14,543 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,543 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:14,557 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,557 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:14,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,557 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:14,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:14,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:14,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:14,559 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:14,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,563 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:14,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,611 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:14,611 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,611 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:14,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-02 21:56:14,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:14,611 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,611 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:14,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:14,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:14,611 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:14,612 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:14,611 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,612 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:14,612 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,612 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,612 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:14,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:14,712 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:14,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:14,715 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-02 21:56:14,717 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:56:14,718 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:56:14,719 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:14,719 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962774719 2023-11-02 21:56:14,723 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:56:14,725 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-02 21:56:14,725 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:56:14,727 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x3ff010c5 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:56:14,754 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@430716fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:56:14,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:56:15,606 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b292c6abc9db4ac486ac00e92de02d97 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103b292c6abc9db4ac486ac00e92de02d97 2023-11-02 21:56:15,608 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:56:15,623 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:56:15,624 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:35042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:56:15,630 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:56:15,631 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:56:15,640 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5fef3d0eca66457e997c8caf275701a3 first=Optional[r3] last=Optional[r6] 2023-11-02 21:56:15,641 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5fef3d0eca66457e997c8caf275701a3}] 2023-11-02 21:56:15,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5fef3d0eca66457e997c8caf275701a3 for inclusion in cf901ed3d958e22b4fac1a5a9cd0edc6/family1 2023-11-02 21:56:15,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-02 21:56:15,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:56:15,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:15,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5fef3d0eca66457e997c8caf275701a3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ma3jsbmqes4713rtqar3omf2jbf6g3ljeonopdtddvu4vho9pj1edf54i5k5npm3/family1/5fef3d0eca66457e997c8caf275701a3 2023-11-02 21:56:15,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ma3jsbmqes4713rtqar3omf2jbf6g3ljeonopdtddvu4vho9pj1edf54i5k5npm3/family1/5fef3d0eca66457e997c8caf275701a3 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/62f2bc07a8144d1f81f6cef286678bab_SeqId_44_ 2023-11-02 21:56:15,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ma3jsbmqes4713rtqar3omf2jbf6g3ljeonopdtddvu4vho9pj1edf54i5k5npm3/family1/5fef3d0eca66457e997c8caf275701a3 into cf901ed3d958e22b4fac1a5a9cd0edc6/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/62f2bc07a8144d1f81f6cef286678bab_SeqId_44_ - updating store file list. 2023-11-02 21:56:15,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/62f2bc07a8144d1f81f6cef286678bab_SeqId_44_ into cf901ed3d958e22b4fac1a5a9cd0edc6/family1 2023-11-02 21:56:15,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ma3jsbmqes4713rtqar3omf2jbf6g3ljeonopdtddvu4vho9pj1edf54i5k5npm3/family1/5fef3d0eca66457e997c8caf275701a3 into cf901ed3d958e22b4fac1a5a9cd0edc6/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/62f2bc07a8144d1f81f6cef286678bab_SeqId_44_) 2023-11-02 21:56:15,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyPolicy__ma3jsbmqes4713rtqar3omf2jbf6g3ljeonopdtddvu4vho9pj1edf54i5k5npm3/family1/5fef3d0eca66457e997c8caf275701a3 2023-11-02 21:56:15,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-02 21:56:15,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-02 21:56:15,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): cf901ed3d958e22b4fac1a5a9cd0edc6/family1 is initiating minor compaction 2023-11-02 21:56:15,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@bb24a34; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:15,666 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cf901ed3d958e22b4fac1a5a9cd0edc6/family1 in testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:15,666 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/98b7703b450949bea1c65b497b9566a2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/60f15bd80e694955ba05d5a880d5b051, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/f4401ebe91fb4ac0b3159c6e608cbba8, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/af6d0497be0440d39158979937510dd8, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/3f7bfccf5c8242aaa859560ac385f63c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/5fce2fc398d04d2eae063257991e8bb9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a946c2ed7d4944cb83360b3483fffaad, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/ea31f61e7b6f4c22b9331c12cbcc9b6c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/0296a85045b54e1f9b997c6331c44d64, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/62f2bc07a8144d1f81f6cef286678bab_SeqId_44_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp, totalSize=50.0 K 2023-11-02 21:56:15,666 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 98b7703b450949bea1c65b497b9566a2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-02 21:56:15,666 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 60f15bd80e694955ba05d5a880d5b051, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-02 21:56:15,666 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting f4401ebe91fb4ac0b3159c6e608cbba8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-02 21:56:15,666 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting af6d0497be0440d39158979937510dd8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-02 21:56:15,667 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 3f7bfccf5c8242aaa859560ac385f63c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-02 21:56:15,667 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 5fce2fc398d04d2eae063257991e8bb9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-02 21:56:15,667 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting a946c2ed7d4944cb83360b3483fffaad, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-02 21:56:15,667 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting ea31f61e7b6f4c22b9331c12cbcc9b6c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-02 21:56:15,667 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 0296a85045b54e1f9b997c6331c44d64, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-02 21:56:15,667 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 62f2bc07a8144d1f81f6cef286678bab_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-02 21:56:15,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:56:15,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:15,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c1919dd6e0214385981431d581ed22f1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c1919dd6e0214385981431d581ed22f1 2023-11-02 21:56:15,674 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512314c5bf65549c344ed8c3948c43a8b1be8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512314c5bf65549c344ed8c3948c43a8b1be8 2023-11-02 21:56:15,677 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101fd3bd82b17d94c66811879920ddb3ade to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101fd3bd82b17d94c66811879920ddb3ade 2023-11-02 21:56:15,678 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1f2acd05be844fc98259cd1942e4256 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1f2acd05be844fc98259cd1942e4256 2023-11-02 21:56:15,678 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-02 21:56:15,678 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-02 21:56:15,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:56:15,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:56:15,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:56:15,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:56:15,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:56:15,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:56:15,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:56:15,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:56:15,702 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): cf901ed3d958e22b4fac1a5a9cd0edc6#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:56:16,523 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/cab8b3d48ef04e2f959db6f709e8b6d0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/cab8b3d48ef04e2f959db6f709e8b6d0 2023-11-02 21:56:16,529 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in cf901ed3d958e22b4fac1a5a9cd0edc6/family1 of cf901ed3d958e22b4fac1a5a9cd0edc6 into cab8b3d48ef04e2f959db6f709e8b6d0(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:56:16,529 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:16,529 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698962175666; duration=0sec 2023-11-02 21:56:16,530 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c8d58a1c1b29423b83af1404b8495067 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c8d58a1c1b29423b83af1404b8495067 2023-11-02 21:56:16,530 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:16,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:56:16,554 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b1561bb9271142978d0fdd5d087ace78 first=Optional[r00] last=Optional[r2] 2023-11-02 21:56:16,555 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b1561bb9271142978d0fdd5d087ace78}] 2023-11-02 21:56:16,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b1561bb9271142978d0fdd5d087ace78 for inclusion in cf901ed3d958e22b4fac1a5a9cd0edc6/family1 2023-11-02 21:56:16,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-02 21:56:16,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:56:16,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:16,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b1561bb9271142978d0fdd5d087ace78 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5o09kfntffkduj6fvib751vcadmrsl23i25hctentcimup1eqt3036e9bhc44ecq/family1/b1561bb9271142978d0fdd5d087ace78 2023-11-02 21:56:16,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5o09kfntffkduj6fvib751vcadmrsl23i25hctentcimup1eqt3036e9bhc44ecq/family1/b1561bb9271142978d0fdd5d087ace78 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/4422bf525a1c41c79fb2ae4690a3e5fc_SeqId_47_ 2023-11-02 21:56:16,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5o09kfntffkduj6fvib751vcadmrsl23i25hctentcimup1eqt3036e9bhc44ecq/family1/b1561bb9271142978d0fdd5d087ace78 into cf901ed3d958e22b4fac1a5a9cd0edc6/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/4422bf525a1c41c79fb2ae4690a3e5fc_SeqId_47_ - updating store file list. 2023-11-02 21:56:16,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/4422bf525a1c41c79fb2ae4690a3e5fc_SeqId_47_ into cf901ed3d958e22b4fac1a5a9cd0edc6/family1 2023-11-02 21:56:16,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5o09kfntffkduj6fvib751vcadmrsl23i25hctentcimup1eqt3036e9bhc44ecq/family1/b1561bb9271142978d0fdd5d087ace78 into cf901ed3d958e22b4fac1a5a9cd0edc6/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/4422bf525a1c41c79fb2ae4690a3e5fc_SeqId_47_) 2023-11-02 21:56:16,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5o09kfntffkduj6fvib751vcadmrsl23i25hctentcimup1eqt3036e9bhc44ecq/family1/b1561bb9271142978d0fdd5d087ace78 2023-11-02 21:56:16,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-02 21:56:16,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-02 21:56:16,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): cf901ed3d958e22b4fac1a5a9cd0edc6/family1 is initiating minor compaction (all files) 2023-11-02 21:56:16,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6256e355; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:16,568 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cf901ed3d958e22b4fac1a5a9cd0edc6/family1 in testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:56:16,568 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a315359adcc74193b273439c49445297, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/cab8b3d48ef04e2f959db6f709e8b6d0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/4422bf525a1c41c79fb2ae4690a3e5fc_SeqId_47_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp, totalSize=337.0 K 2023-11-02 21:56:16,569 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting a315359adcc74193b273439c49445297, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878810443 2023-11-02 21:56:16,569 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting cab8b3d48ef04e2f959db6f709e8b6d0, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621210443 2023-11-02 21:56:16,569 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 4422bf525a1c41c79fb2ae4690a3e5fc_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878810443 2023-11-02 21:56:16,570 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:56:16,570 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:16,572 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130898f552a4fd44f4baad7e9a662ab7611 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130898f552a4fd44f4baad7e9a662ab7611 2023-11-02 21:56:16,573 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011e4014682b614967bba6d0369eebfd43 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011e4014682b614967bba6d0369eebfd43 2023-11-02 21:56:16,574 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512058a4a66d3efbf4bcb9a992ca57b78d005 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512058a4a66d3efbf4bcb9a992ca57b78d005 2023-11-02 21:56:16,574 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-02 21:56:16,574 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-02 21:56:16,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-02 21:56:16,574 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-02 21:56:16,574 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:16,575 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:56:16,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8590 sec 2023-11-02 21:56:16,587 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): cf901ed3d958e22b4fac1a5a9cd0edc6#family1#compaction#50 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:56:16,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/98b7703b450949bea1c65b497b9566a2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/60f15bd80e694955ba05d5a880d5b051, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/f4401ebe91fb4ac0b3159c6e608cbba8, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/af6d0497be0440d39158979937510dd8, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/3f7bfccf5c8242aaa859560ac385f63c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/5fce2fc398d04d2eae063257991e8bb9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a946c2ed7d4944cb83360b3483fffaad, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/ea31f61e7b6f4c22b9331c12cbcc9b6c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/0296a85045b54e1f9b997c6331c44d64, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/62f2bc07a8144d1f81f6cef286678bab_SeqId_44_] to archive 2023-11-02 21:56:16,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:16,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/98b7703b450949bea1c65b497b9566a2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/98b7703b450949bea1c65b497b9566a2 2023-11-02 21:56:16,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/60f15bd80e694955ba05d5a880d5b051 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/60f15bd80e694955ba05d5a880d5b051 2023-11-02 21:56:16,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/f4401ebe91fb4ac0b3159c6e608cbba8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/f4401ebe91fb4ac0b3159c6e608cbba8 2023-11-02 21:56:16,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/af6d0497be0440d39158979937510dd8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/af6d0497be0440d39158979937510dd8 2023-11-02 21:56:16,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/3f7bfccf5c8242aaa859560ac385f63c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/3f7bfccf5c8242aaa859560ac385f63c 2023-11-02 21:56:16,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/5fce2fc398d04d2eae063257991e8bb9 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/5fce2fc398d04d2eae063257991e8bb9 2023-11-02 21:56:16,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a946c2ed7d4944cb83360b3483fffaad to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a946c2ed7d4944cb83360b3483fffaad 2023-11-02 21:56:16,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/ea31f61e7b6f4c22b9331c12cbcc9b6c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/ea31f61e7b6f4c22b9331c12cbcc9b6c 2023-11-02 21:56:16,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/0296a85045b54e1f9b997c6331c44d64 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/0296a85045b54e1f9b997c6331c44d64 2023-11-02 21:56:16,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/62f2bc07a8144d1f81f6cef286678bab_SeqId_44_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/62f2bc07a8144d1f81f6cef286678bab_SeqId_44_ 2023-11-02 21:56:16,668 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251 (was 248) - Thread LEAK? -, OpenFileDescriptor=628 (was 612) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=171 (was 210), ProcessCount=174 (was 174), AvailableMemoryMB=475 (was 482) 2023-11-02 21:56:16,680 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=251, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=171, ProcessCount=174, AvailableMemoryMB=474 2023-11-02 21:56:16,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-02 21:56:16,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:16,685 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:56:16,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-02 21:56:16,686 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:56:16,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-02 21:56:16,687 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:16,688 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014 empty. 2023-11-02 21:56:16,688 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:16,688 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-02 21:56:16,699 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-02 21:56:16,700 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 12a2ddbbcd3cbf817e3db2e855e7a014, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:56:16,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-02 21:56:16,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-02 21:56:17,110 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:17,110 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 12a2ddbbcd3cbf817e3db2e855e7a014, disabling compactions & flushes 2023-11-02 21:56:17,110 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:17,110 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:17,110 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. after waiting 0 ms 2023-11-02 21:56:17,110 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:17,111 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:17,111 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:17,115 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:56:17,116 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962177116"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962177116"}]},"ts":"1698962177116"} 2023-11-02 21:56:17,118 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-02 21:56:17,119 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:56:17,119 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962177119"}]},"ts":"1698962177119"} 2023-11-02 21:56:17,121 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-02 21:56:17,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, ASSIGN}] 2023-11-02 21:56:17,235 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, ASSIGN 2023-11-02 21:56:17,237 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:56:17,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-02 21:56:17,388 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=12a2ddbbcd3cbf817e3db2e855e7a014, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:17,388 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962177388"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962177388"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962177388"}]},"ts":"1698962177388"} 2023-11-02 21:56:17,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 12a2ddbbcd3cbf817e3db2e855e7a014, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:17,541 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:17,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:17,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12a2ddbbcd3cbf817e3db2e855e7a014, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:56:17,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:17,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:17,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:17,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:17,549 INFO [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:17,551 DEBUG [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:17,551 DEBUG [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:17,552 INFO [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12a2ddbbcd3cbf817e3db2e855e7a014 columnFamilyName family1 2023-11-02 21:56:17,554 INFO [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] regionserver.HStore(310): Store=12a2ddbbcd3cbf817e3db2e855e7a014/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:17,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:17,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:17,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:17,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:56:17,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 12a2ddbbcd3cbf817e3db2e855e7a014; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59080604, jitterRate=-0.11963039636611938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:56:17,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:17,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014., pid=41, masterSystemTime=1698962177541 2023-11-02 21:56:17,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:17,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:17,568 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=12a2ddbbcd3cbf817e3db2e855e7a014, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:17,568 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962177568"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962177568"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962177568"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962177568"}]},"ts":"1698962177568"} 2023-11-02 21:56:17,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-02 21:56:17,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 12a2ddbbcd3cbf817e3db2e855e7a014, server=jenkins-hbase12.apache.org,33583,1698962105160 in 180 msec 2023-11-02 21:56:17,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-02 21:56:17,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, ASSIGN in 343 msec 2023-11-02 21:56:17,577 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:56:17,577 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962177577"}]},"ts":"1698962177577"} 2023-11-02 21:56:17,579 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-02 21:56:17,641 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:56:17,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 959 msec 2023-11-02 21:56:17,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-02 21:56:17,794 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-02 21:56:17,808 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/.tmp/family1/26eb5a96f97f4176bcfacf377613fcb7 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/26eb5a96f97f4176bcfacf377613fcb7 2023-11-02 21:56:17,815 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cf901ed3d958e22b4fac1a5a9cd0edc6/family1 of cf901ed3d958e22b4fac1a5a9cd0edc6 into 26eb5a96f97f4176bcfacf377613fcb7(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:56:17,815 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:56:17,815 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1698962176568; duration=1sec 2023-11-02 21:56:17,815 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:17,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a315359adcc74193b273439c49445297, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/cab8b3d48ef04e2f959db6f709e8b6d0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/4422bf525a1c41c79fb2ae4690a3e5fc_SeqId_47_] to archive 2023-11-02 21:56:17,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:17,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a315359adcc74193b273439c49445297 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/a315359adcc74193b273439c49445297 2023-11-02 21:56:17,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/cab8b3d48ef04e2f959db6f709e8b6d0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/cab8b3d48ef04e2f959db6f709e8b6d0 2023-11-02 21:56:17,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:17,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/4422bf525a1c41c79fb2ae4690a3e5fc_SeqId_47_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/family1/4422bf525a1c41c79fb2ae4690a3e5fc_SeqId_47_ 2023-11-02 21:56:17,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:17,830 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:17,830 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:17,830 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-02 21:56:17,830 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-02 21:56:17,830 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:17,830 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:17,840 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:17,841 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:17,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:17,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:17,841 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:17,841 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:17,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:17,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:17,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:17,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:17,842 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:17,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:17,842 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-02 21:56:17,842 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:17,842 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-02 21:56:17,842 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:17,842 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:17,842 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:17,842 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. started... 2023-11-02 21:56:17,843 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12a2ddbbcd3cbf817e3db2e855e7a014 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-02 21:56:18,262 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e14377193ad94fd1a0b09c78140643ba to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130e14377193ad94fd1a0b09c78140643ba 2023-11-02 21:56:18,668 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/bb44bb8dec214759b0e6efa663df90f4 2023-11-02 21:56:18,676 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/bb44bb8dec214759b0e6efa663df90f4 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/bb44bb8dec214759b0e6efa663df90f4 2023-11-02 21:56:18,681 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/bb44bb8dec214759b0e6efa663df90f4, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-02 21:56:18,682 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 12a2ddbbcd3cbf817e3db2e855e7a014 in 839ms, sequenceid=5, compaction requested=false 2023-11-02 21:56:18,682 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:18,683 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:18,683 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:18,683 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:18,683 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:18,683 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,683 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-02 21:56:18,683 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-02 21:56:18,746 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,746 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:18,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:18,747 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,747 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:18,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:18,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-02 21:56:18,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78411125[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:18,752 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-02 21:56:18,752 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,763 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,764 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-02 21:56:18,764 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-02 21:56:18,764 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:18,764 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,764 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:18,774 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-02 21:56:18,774 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:18,774 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-02 21:56:18,774 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:18,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:18,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:18,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-02 21:56:18,780 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-02 21:56:18,780 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:18,780 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:18,780 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,780 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:18,788 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,788 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:18,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,788 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:18,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:18,789 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,792 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:18,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,806 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,806 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:18,806 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,806 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:18,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:18,806 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:18,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:18,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-02 21:56:18,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:18,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:18,806 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,807 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,807 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,807 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,807 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:18,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:18,807 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:18,808 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:18,908 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:18,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:18,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:18,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:18,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,916 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:18,916 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:18,916 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-02 21:56:18,916 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-02 21:56:18,917 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,917 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,925 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,925 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:18,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:18,925 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:18,925 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,926 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-02 21:56:18,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:18,927 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-02 21:56:18,927 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:18,927 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-02 21:56:18,927 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:18,927 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:18,927 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:18,927 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. started... 2023-11-02 21:56:18,927 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12a2ddbbcd3cbf817e3db2e855e7a014 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-02 21:56:19,347 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d980e62a13e14290bf52bd92f2a2d865 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d980e62a13e14290bf52bd92f2a2d865 2023-11-02 21:56:19,759 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/c7775dbdd54647028eb4e41fea98ade3 2023-11-02 21:56:19,955 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/c7775dbdd54647028eb4e41fea98ade3 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/c7775dbdd54647028eb4e41fea98ade3 2023-11-02 21:56:19,961 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/c7775dbdd54647028eb4e41fea98ade3, entries=1, sequenceid=9, filesize=5.0 K 2023-11-02 21:56:19,961 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 12a2ddbbcd3cbf817e3db2e855e7a014 in 1034ms, sequenceid=9, compaction requested=false 2023-11-02 21:56:19,962 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:19,962 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:19,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:19,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:19,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:19,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-02 21:56:19,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-02 21:56:20,048 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,048 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:20,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:20,050 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,050 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:20,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:20,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:20,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-02 21:56:20,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e90cc2a[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:20,056 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-02 21:56:20,056 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,083 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,083 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-02 21:56:20,083 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-02 21:56:20,083 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:20,084 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,084 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:20,093 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-02 21:56:20,093 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:20,094 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-02 21:56:20,093 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:20,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:20,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:20,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:20,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:20,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:20,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-02 21:56:20,103 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-02 21:56:20,103 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:20,103 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:20,103 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,103 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:20,114 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,114 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:20,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:20,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,114 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:20,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:20,116 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:20,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,120 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,161 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:20,161 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,162 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:20,162 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:20,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-02 21:56:20,162 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:20,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:20,162 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:20,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:20,163 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,163 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,163 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,163 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,163 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:20,164 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:20,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:20,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:20,264 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:20,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:20,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:20,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:20,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,276 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:20,276 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:20,276 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-02 21:56:20,276 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-02 21:56:20,277 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,277 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,293 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:20,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:20,294 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:20,294 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,295 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,295 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-02 21:56:20,295 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:20,295 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-02 21:56:20,295 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:20,295 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-02 21:56:20,295 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:20,296 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:20,296 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:20,296 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. started... 2023-11-02 21:56:20,296 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12a2ddbbcd3cbf817e3db2e855e7a014 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:20,714 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013ffb54567ffe4e96a662341e2dee0eda to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512013ffb54567ffe4e96a662341e2dee0eda 2023-11-02 21:56:21,122 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/a786fe1ee546469389ff6432f36dc756 2023-11-02 21:56:21,132 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/a786fe1ee546469389ff6432f36dc756 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/a786fe1ee546469389ff6432f36dc756 2023-11-02 21:56:21,138 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/a786fe1ee546469389ff6432f36dc756, entries=1, sequenceid=13, filesize=5.0 K 2023-11-02 21:56:21,139 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12a2ddbbcd3cbf817e3db2e855e7a014 in 843ms, sequenceid=13, compaction requested=true 2023-11-02 21:56:21,139 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:21,139 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:21,139 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:21,139 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:21,139 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,139 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-02 21:56:21,139 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-02 21:56:21,219 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,220 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:21,221 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,221 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:21,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:21,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:21,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-02 21:56:21,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7015b3c2[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:21,227 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-02 21:56:21,227 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,240 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,241 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-02 21:56:21,241 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-02 21:56:21,241 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:21,241 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,241 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:21,251 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,251 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-02 21:56:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:21,251 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:21,252 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-02 21:56:21,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:21,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:21,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:21,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-02 21:56:21,257 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-02 21:56:21,257 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:21,257 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:21,257 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,257 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:21,268 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,269 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:21,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,268 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:21,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:21,269 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:21,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,270 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:21,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,282 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,282 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:21,282 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:21,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:21,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:21,282 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-02 21:56:21,282 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:21,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:21,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:21,283 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,283 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,283 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:21,283 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,283 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,283 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,283 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:21,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:21,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:21,384 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:21,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:21,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:21,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:21,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,389 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:21,389 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:21,389 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-02 21:56:21,389 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-02 21:56:21,390 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,390 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,398 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:21,398 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:21,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:21,399 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,399 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:21,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:21,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,400 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,400 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-02 21:56:21,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,400 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-02 21:56:21,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:21,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-02 21:56:21,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:21,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:21,401 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:21,401 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. started... 2023-11-02 21:56:21,401 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12a2ddbbcd3cbf817e3db2e855e7a014 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:21,821 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059808805ebcc84e91ba1344dd924bb58a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512059808805ebcc84e91ba1344dd924bb58a 2023-11-02 21:56:21,827 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/64dc11b4998547b1b419143eef3dd2af 2023-11-02 21:56:21,831 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/64dc11b4998547b1b419143eef3dd2af as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/64dc11b4998547b1b419143eef3dd2af 2023-11-02 21:56:21,835 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/64dc11b4998547b1b419143eef3dd2af, entries=1, sequenceid=17, filesize=5.0 K 2023-11-02 21:56:21,835 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12a2ddbbcd3cbf817e3db2e855e7a014 in 434ms, sequenceid=17, compaction requested=true 2023-11-02 21:56:21,836 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:21,836 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:21,836 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:21,836 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:21,836 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,836 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-02 21:56:21,836 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-02 21:56:21,893 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,893 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:21,894 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,894 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:21,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:21,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-02 21:56:21,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d4366c4[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:21,898 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-02 21:56:21,898 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,910 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,911 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-02 21:56:21,911 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-02 21:56:21,911 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:21,911 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,911 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:21,921 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-02 21:56:21,921 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:21,921 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-02 21:56:21,921 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:21,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:21,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:21,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:21,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:21,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:21,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-02 21:56:21,925 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-02 21:56:21,925 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:21,926 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:21,926 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,926 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:21,935 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,935 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:21,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:21,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,935 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:21,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:21,935 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:21,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,936 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:21,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,945 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,945 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,945 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:21,945 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,946 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:21,946 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:21,945 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:21,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:21,946 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:21,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:21,946 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,946 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:21,946 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:21,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:21,946 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:22,046 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:22,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:22,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:22,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:22,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:22,063 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:22,063 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:22,063 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-02 21:56:22,063 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-02 21:56:22,064 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:22,064 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:22,099 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:22,099 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:22,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:22,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:22,099 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:22,099 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:22,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:22,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:22,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:22,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:22,101 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:22,101 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-02 21:56:22,101 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:22,101 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-02 21:56:22,101 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:22,101 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-02 21:56:22,102 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:22,102 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:22,102 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:22,102 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. started... 2023-11-02 21:56:22,102 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12a2ddbbcd3cbf817e3db2e855e7a014 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:22,529 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281d97aabe3fe945feb4ab3697437f5939 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281d97aabe3fe945feb4ab3697437f5939 2023-11-02 21:56:22,937 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/e503560cd6064b5d872f29dcf492850d 2023-11-02 21:56:22,949 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/e503560cd6064b5d872f29dcf492850d as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/e503560cd6064b5d872f29dcf492850d 2023-11-02 21:56:22,955 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/e503560cd6064b5d872f29dcf492850d, entries=1, sequenceid=21, filesize=5.0 K 2023-11-02 21:56:22,955 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12a2ddbbcd3cbf817e3db2e855e7a014 in 853ms, sequenceid=21, compaction requested=true 2023-11-02 21:56:22,955 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:22,955 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:22,955 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:22,955 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:22,955 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:22,956 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-02 21:56:22,956 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-02 21:56:23,020 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,020 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:23,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:23,021 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,021 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:23,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:23,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:23,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:23,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-02 21:56:23,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dfb8a70[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:23,028 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-02 21:56:23,028 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,040 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,041 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-02 21:56:23,041 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-02 21:56:23,041 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:23,041 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,041 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:23,051 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-02 21:56:23,051 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,051 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:23,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:23,051 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-02 21:56:23,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:23,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:23,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:23,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:23,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:23,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-02 21:56:23,062 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-02 21:56:23,062 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:23,062 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:23,062 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,062 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:23,072 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,072 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,072 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:23,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:23,073 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,076 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,076 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:56:23,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,089 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,090 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:23,090 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:23,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:23,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:23,090 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:23,090 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,090 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:23,090 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,090 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:23,090 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:23,090 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,090 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:23,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-02 21:56:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:23,090 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,191 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:23,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:23,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:23,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:23,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,203 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:23,203 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:23,203 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-02 21:56:23,203 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-02 21:56:23,204 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,204 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,216 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:23,216 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:23,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:23,217 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,217 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:23,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:23,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,219 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,219 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-02 21:56:23,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,219 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-02 21:56:23,220 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:23,220 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-02 21:56:23,220 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:23,220 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:23,220 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:23,221 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. started... 2023-11-02 21:56:23,221 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12a2ddbbcd3cbf817e3db2e855e7a014 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:23,644 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f0a1a584eec843f7b46ca544c5fb24b1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231f0a1a584eec843f7b46ca544c5fb24b1 2023-11-02 21:56:23,651 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/f323cce403f14db09d087e567db5fdcd 2023-11-02 21:56:23,656 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/f323cce403f14db09d087e567db5fdcd as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f323cce403f14db09d087e567db5fdcd 2023-11-02 21:56:23,660 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f323cce403f14db09d087e567db5fdcd, entries=1, sequenceid=25, filesize=5.0 K 2023-11-02 21:56:23,660 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12a2ddbbcd3cbf817e3db2e855e7a014 in 439ms, sequenceid=25, compaction requested=true 2023-11-02 21:56:23,660 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:23,661 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:23,661 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:23,661 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:23,661 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,661 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-02 21:56:23,661 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-02 21:56:23,714 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,714 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:23,715 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,715 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:23,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:23,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:23,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-02 21:56:23,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1502f479[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:23,720 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-02 21:56:23,721 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,732 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,732 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-02 21:56:23,732 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-02 21:56:23,732 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:23,732 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,732 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:23,742 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-02 21:56:23,742 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:23,742 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,742 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-02 21:56:23,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:23,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:23,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:23,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-02 21:56:23,745 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-02 21:56:23,745 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:23,745 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:23,745 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,745 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:23,756 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,756 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:23,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:23,756 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:23,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:23,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:23,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:23,757 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:23,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,758 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,766 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,766 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:23,766 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:23,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:23,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:23,766 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:23,766 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:23,766 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,767 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:23,767 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:23,767 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:23,767 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,767 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,767 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,867 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:23,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:23,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:23,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:23,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,873 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:23,873 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:23,873 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-02 21:56:23,873 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-02 21:56:23,874 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,874 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,882 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:23,882 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:23,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:23,883 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:23,883 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:23,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:23,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,884 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,884 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-02 21:56:23,884 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:23,884 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-02 21:56:23,884 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:23,885 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-02 21:56:23,885 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:23,885 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:23,885 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:23,885 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. started... 2023-11-02 21:56:23,885 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12a2ddbbcd3cbf817e3db2e855e7a014 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:24,305 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010182a5489d03314ee0b367838cbefeb783 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010182a5489d03314ee0b367838cbefeb783 2023-11-02 21:56:24,713 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/12d58e93b03b489a8f64f22c8e88d4a0 2023-11-02 21:56:24,720 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/12d58e93b03b489a8f64f22c8e88d4a0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/12d58e93b03b489a8f64f22c8e88d4a0 2023-11-02 21:56:24,728 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/12d58e93b03b489a8f64f22c8e88d4a0, entries=1, sequenceid=29, filesize=5.0 K 2023-11-02 21:56:24,730 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12a2ddbbcd3cbf817e3db2e855e7a014 in 845ms, sequenceid=29, compaction requested=true 2023-11-02 21:56:24,730 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:24,730 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:24,730 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:24,730 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:24,730 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,730 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-02 21:56:24,730 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-02 21:56:24,777 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,777 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:24,778 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,778 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:24,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:24,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-02 21:56:24,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48d4ceb8[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:24,783 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-02 21:56:24,783 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,826 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,826 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-02 21:56:24,826 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-02 21:56:24,826 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:24,826 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,827 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:24,847 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-02 21:56:24,848 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:24,848 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-02 21:56:24,847 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:24,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:24,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:24,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:24,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:24,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-02 21:56:24,857 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-02 21:56:24,857 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:24,857 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:24,857 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,857 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:24,872 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,872 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,872 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:24,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:24,873 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:24,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,876 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:24,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,890 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:24,890 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,890 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:24,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:24,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:24,890 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:24,890 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,890 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:24,891 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:24,890 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:24,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:24,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:24,890 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:24,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-02 21:56:24,891 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,891 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,891 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:24,991 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:24,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:25,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:25,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:25,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:25,009 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:25,009 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:25,010 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-02 21:56:25,010 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-02 21:56:25,011 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:25,011 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:25,019 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:25,019 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:25,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:25,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:25,020 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:25,020 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:25,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:25,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:25,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:25,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:25,021 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:25,022 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-02 21:56:25,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:25,022 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-02 21:56:25,022 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:25,022 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-02 21:56:25,022 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:25,022 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:25,022 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:25,022 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. started... 2023-11-02 21:56:25,023 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12a2ddbbcd3cbf817e3db2e855e7a014 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:25,442 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010341d4a8fe34d4494bba6a239e40517a8b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010341d4a8fe34d4494bba6a239e40517a8b 2023-11-02 21:56:25,851 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/b8a29833b7474420bf9fc8f8ff4383b4 2023-11-02 21:56:25,860 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/b8a29833b7474420bf9fc8f8ff4383b4 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b8a29833b7474420bf9fc8f8ff4383b4 2023-11-02 21:56:25,869 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b8a29833b7474420bf9fc8f8ff4383b4, entries=1, sequenceid=33, filesize=5.0 K 2023-11-02 21:56:25,870 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12a2ddbbcd3cbf817e3db2e855e7a014 in 847ms, sequenceid=33, compaction requested=true 2023-11-02 21:56:25,870 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:25,870 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:25,870 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:25,870 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:25,870 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:25,870 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-02 21:56:25,870 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-02 21:56:26,094 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,094 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:26,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:26,095 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,095 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:26,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:26,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:26,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:26,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-02 21:56:26,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e57e420[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:26,098 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-02 21:56:26,098 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,124 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-02 21:56:26,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-02 21:56:26,125 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:26,126 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,126 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:26,135 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,135 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-02 21:56:26,135 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:26,135 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-02 21:56:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:26,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:26,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:26,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:26,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-02 21:56:26,145 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-02 21:56:26,145 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:26,146 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:26,146 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,146 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:26,156 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,156 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,156 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:26,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:26,157 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:26,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,159 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:26,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,174 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,174 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:26,174 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:26,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:26,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:26,174 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:26,174 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,175 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,174 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:26,175 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,175 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:26,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:26,175 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:26,175 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:26,176 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,276 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:26,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:26,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:26,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:26,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,285 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:26,285 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:26,285 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-02 21:56:26,285 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-02 21:56:26,286 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,286 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:26,293 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:26,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:26,294 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:26,294 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:26,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:26,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,296 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,297 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-02 21:56:26,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:26,297 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-02 21:56:26,297 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:26,297 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-02 21:56:26,297 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:26,297 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:26,297 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:26,298 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. started... 2023-11-02 21:56:26,298 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12a2ddbbcd3cbf817e3db2e855e7a014 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:26,711 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907175da1982ce9450d940d3e48a6fd630f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907175da1982ce9450d940d3e48a6fd630f 2023-11-02 21:56:27,117 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/38bffb95c2474ec28a8f9e461512c37e 2023-11-02 21:56:27,129 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/38bffb95c2474ec28a8f9e461512c37e as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/38bffb95c2474ec28a8f9e461512c37e 2023-11-02 21:56:27,137 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/38bffb95c2474ec28a8f9e461512c37e, entries=1, sequenceid=37, filesize=5.0 K 2023-11-02 21:56:27,138 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12a2ddbbcd3cbf817e3db2e855e7a014 in 840ms, sequenceid=37, compaction requested=true 2023-11-02 21:56:27,138 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:27,138 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:27,138 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:27,138 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:27,139 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,139 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-02 21:56:27,139 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-02 21:56:27,208 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,208 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:27,209 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,209 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:27,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-02 21:56:27,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fbe4190[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:27,211 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-02 21:56:27,211 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,219 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,219 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-02 21:56:27,219 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-02 21:56:27,219 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:27,219 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,219 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:27,229 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-02 21:56:27,229 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:27,229 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-02 21:56:27,229 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:27,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:27,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:27,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:27,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-02 21:56:27,232 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-02 21:56:27,233 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:27,233 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:27,233 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,233 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:27,269 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,269 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:27,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,269 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:27,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:27,270 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,271 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:27,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:27,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:27,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:27,293 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:27,293 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:27,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:27,394 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:27,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:27,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:27,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:27,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,405 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:27,405 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:27,405 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-02 21:56:27,405 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-02 21:56:27,406 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,406 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,437 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:27,437 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:27,438 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:27,438 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:27,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,441 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,441 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-02 21:56:27,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:27,442 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-02 21:56:27,442 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:27,442 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-02 21:56:27,442 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:27,442 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:27,443 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:27,443 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. started... 2023-11-02 21:56:27,443 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 12a2ddbbcd3cbf817e3db2e855e7a014 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:27,872 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120471536291a7149ddb569e7f329cdee17 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120471536291a7149ddb569e7f329cdee17 2023-11-02 21:56:28,280 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/f5601333afa14ba5bd56bb9aeab18376 2023-11-02 21:56:28,285 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/f5601333afa14ba5bd56bb9aeab18376 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f5601333afa14ba5bd56bb9aeab18376 2023-11-02 21:56:28,290 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f5601333afa14ba5bd56bb9aeab18376, entries=1, sequenceid=41, filesize=5.0 K 2023-11-02 21:56:28,290 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12a2ddbbcd3cbf817e3db2e855e7a014 in 847ms, sequenceid=41, compaction requested=true 2023-11-02 21:56:28,291 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:28,291 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:28,291 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:28,291 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:28,291 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,291 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-02 21:56:28,291 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-02 21:56:28,303 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,303 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:28,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:28,303 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,303 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:28,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:28,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-02 21:56:28,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d9dd322[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:28,305 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-02 21:56:28,305 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,313 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,314 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-02 21:56:28,314 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-02 21:56:28,314 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:28,314 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,314 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:28,324 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-02 21:56:28,324 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:28,324 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-02 21:56:28,324 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:28,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-02 21:56:28,330 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-02 21:56:28,330 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:28,330 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:28,331 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,331 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:28,342 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,342 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:28,342 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:28,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:28,343 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,345 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,356 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,356 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,356 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:28,356 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:28,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:28,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:28,356 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,356 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:28,356 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-02 21:56:28,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:28,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:28,356 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:28,356 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:28,356 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,357 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,357 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:28,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:28,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:28,457 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:28,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:28,461 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:28,463 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-02 21:56:28,464 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-02 21:56:28,466 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:28,466 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962788465 2023-11-02 21:56:28,470 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:56:28,472 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-02 21:56:28,472 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:28,474 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x70d0c2af to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:56:28,490 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1246dec5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:56:28,490 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:29,341 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103365e2efa46394a7b885285d1da853fa8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103365e2efa46394a7b885285d1da853fa8 2023-11-02 21:56:29,342 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:29,353 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:56:29,354 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:56:29,361 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:56:29,363 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:58420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:56:29,372 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7245f869768546a1bfee645baf8dd254 first=Optional[r3] last=Optional[r6] 2023-11-02 21:56:29,373 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7245f869768546a1bfee645baf8dd254}] 2023-11-02 21:56:29,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7245f869768546a1bfee645baf8dd254 for inclusion in 12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:29,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-02 21:56:29,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:56:29,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:29,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7245f869768546a1bfee645baf8dd254 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5drohap5f2cv60bmas074khtlsvnh1qaqrsc60ca21ks9heu8ghiipgpc4g9ugc/family1/7245f869768546a1bfee645baf8dd254 2023-11-02 21:56:29,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5drohap5f2cv60bmas074khtlsvnh1qaqrsc60ca21ks9heu8ghiipgpc4g9ugc/family1/7245f869768546a1bfee645baf8dd254 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/538098a1f8fa483289d68b0ca1e3b8cf_SeqId_44_ 2023-11-02 21:56:29,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5drohap5f2cv60bmas074khtlsvnh1qaqrsc60ca21ks9heu8ghiipgpc4g9ugc/family1/7245f869768546a1bfee645baf8dd254 into 12a2ddbbcd3cbf817e3db2e855e7a014/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/538098a1f8fa483289d68b0ca1e3b8cf_SeqId_44_ - updating store file list. 2023-11-02 21:56:29,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/538098a1f8fa483289d68b0ca1e3b8cf_SeqId_44_ into 12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:29,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5drohap5f2cv60bmas074khtlsvnh1qaqrsc60ca21ks9heu8ghiipgpc4g9ugc/family1/7245f869768546a1bfee645baf8dd254 into 12a2ddbbcd3cbf817e3db2e855e7a014/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/538098a1f8fa483289d68b0ca1e3b8cf_SeqId_44_) 2023-11-02 21:56:29,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5drohap5f2cv60bmas074khtlsvnh1qaqrsc60ca21ks9heu8ghiipgpc4g9ugc/family1/7245f869768546a1bfee645baf8dd254 2023-11-02 21:56:29,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-02 21:56:29,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-02 21:56:29,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 12a2ddbbcd3cbf817e3db2e855e7a014/family1 is initiating minor compaction 2023-11-02 21:56:29,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4a0bc7ad; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:29,393 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 12a2ddbbcd3cbf817e3db2e855e7a014/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:29,393 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/c7775dbdd54647028eb4e41fea98ade3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/a786fe1ee546469389ff6432f36dc756, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/64dc11b4998547b1b419143eef3dd2af, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/e503560cd6064b5d872f29dcf492850d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f323cce403f14db09d087e567db5fdcd, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/12d58e93b03b489a8f64f22c8e88d4a0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b8a29833b7474420bf9fc8f8ff4383b4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/38bffb95c2474ec28a8f9e461512c37e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f5601333afa14ba5bd56bb9aeab18376, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/538098a1f8fa483289d68b0ca1e3b8cf_SeqId_44_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp, totalSize=50.4 K 2023-11-02 21:56:29,393 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting c7775dbdd54647028eb4e41fea98ade3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-02 21:56:29,393 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting a786fe1ee546469389ff6432f36dc756, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-02 21:56:29,393 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 64dc11b4998547b1b419143eef3dd2af, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-02 21:56:29,394 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting e503560cd6064b5d872f29dcf492850d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-02 21:56:29,394 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting f323cce403f14db09d087e567db5fdcd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-02 21:56:29,394 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 12d58e93b03b489a8f64f22c8e88d4a0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-02 21:56:29,394 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting b8a29833b7474420bf9fc8f8ff4383b4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-02 21:56:29,394 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 38bffb95c2474ec28a8f9e461512c37e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-02 21:56:29,394 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting f5601333afa14ba5bd56bb9aeab18376, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-02 21:56:29,394 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 538098a1f8fa483289d68b0ca1e3b8cf_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-02 21:56:29,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:29,395 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:29,397 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281d97aabe3fe945feb4ab3697437f5939 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281d97aabe3fe945feb4ab3697437f5939 2023-11-02 21:56:29,398 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231f0a1a584eec843f7b46ca544c5fb24b1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231f0a1a584eec843f7b46ca544c5fb24b1 2023-11-02 21:56:29,399 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010182a5489d03314ee0b367838cbefeb783 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010182a5489d03314ee0b367838cbefeb783 2023-11-02 21:56:29,400 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010341d4a8fe34d4494bba6a239e40517a8b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010341d4a8fe34d4494bba6a239e40517a8b 2023-11-02 21:56:29,400 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-02 21:56:29,400 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-02 21:56:29,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:29,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:29,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:29,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:29,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:29,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:29,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:29,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:29,419 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 12a2ddbbcd3cbf817e3db2e855e7a014#family1#compaction#61 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:56:30,243 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/d8140cad45f14a4d8d7a33f40e356778 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/d8140cad45f14a4d8d7a33f40e356778 2023-11-02 21:56:30,251 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 12a2ddbbcd3cbf817e3db2e855e7a014/family1 of 12a2ddbbcd3cbf817e3db2e855e7a014 into d8140cad45f14a4d8d7a33f40e356778(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:56:30,251 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:30,251 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698962189393; duration=0sec 2023-11-02 21:56:30,251 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:30,253 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120514d1950f6b614e80a367f47f52478de7 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120514d1950f6b614e80a367f47f52478de7 2023-11-02 21:56:30,253 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:30,275 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/24c8916a5a094eabacde0985a5f56c61 first=Optional[r00] last=Optional[r2] 2023-11-02 21:56:30,276 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/24c8916a5a094eabacde0985a5f56c61}] 2023-11-02 21:56:30,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/24c8916a5a094eabacde0985a5f56c61 for inclusion in 12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:30,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-02 21:56:30,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:56:30,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:30,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/24c8916a5a094eabacde0985a5f56c61 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ttjg759ue0cbtu8d2senun0pnvndkok4777e4t38c4gjb9hpka9nbejnqgu8a075/family1/24c8916a5a094eabacde0985a5f56c61 2023-11-02 21:56:30,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ttjg759ue0cbtu8d2senun0pnvndkok4777e4t38c4gjb9hpka9nbejnqgu8a075/family1/24c8916a5a094eabacde0985a5f56c61 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b446954d11f8404a95c544a48a419d38_SeqId_47_ 2023-11-02 21:56:30,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ttjg759ue0cbtu8d2senun0pnvndkok4777e4t38c4gjb9hpka9nbejnqgu8a075/family1/24c8916a5a094eabacde0985a5f56c61 into 12a2ddbbcd3cbf817e3db2e855e7a014/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b446954d11f8404a95c544a48a419d38_SeqId_47_ - updating store file list. 2023-11-02 21:56:30,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b446954d11f8404a95c544a48a419d38_SeqId_47_ into 12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:30,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ttjg759ue0cbtu8d2senun0pnvndkok4777e4t38c4gjb9hpka9nbejnqgu8a075/family1/24c8916a5a094eabacde0985a5f56c61 into 12a2ddbbcd3cbf817e3db2e855e7a014/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b446954d11f8404a95c544a48a419d38_SeqId_47_) 2023-11-02 21:56:30,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ttjg759ue0cbtu8d2senun0pnvndkok4777e4t38c4gjb9hpka9nbejnqgu8a075/family1/24c8916a5a094eabacde0985a5f56c61 2023-11-02 21:56:30,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-02 21:56:30,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-02 21:56:30,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 12a2ddbbcd3cbf817e3db2e855e7a014/family1 is initiating minor compaction (all files) 2023-11-02 21:56:30,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2ef9ac70; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:30,292 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 12a2ddbbcd3cbf817e3db2e855e7a014/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:30,292 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/bb44bb8dec214759b0e6efa663df90f4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/d8140cad45f14a4d8d7a33f40e356778, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b446954d11f8404a95c544a48a419d38_SeqId_47_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp, totalSize=390.1 K 2023-11-02 21:56:30,293 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting bb44bb8dec214759b0e6efa663df90f4, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878810443 2023-11-02 21:56:30,293 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting d8140cad45f14a4d8d7a33f40e356778, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621210443 2023-11-02 21:56:30,294 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting b446954d11f8404a95c544a48a419d38_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878810443 2023-11-02 21:56:30,294 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:30,295 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:30,297 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130e14377193ad94fd1a0b09c78140643ba to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130e14377193ad94fd1a0b09c78140643ba 2023-11-02 21:56:30,298 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512013ffb54567ffe4e96a662341e2dee0eda to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512013ffb54567ffe4e96a662341e2dee0eda 2023-11-02 21:56:30,300 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512059808805ebcc84e91ba1344dd924bb58a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512059808805ebcc84e91ba1344dd924bb58a 2023-11-02 21:56:30,300 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-02 21:56:30,300 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-02 21:56:30,300 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:30,300 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:30,300 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:30,301 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-02 21:56:30,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8390 sec 2023-11-02 21:56:30,310 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 12a2ddbbcd3cbf817e3db2e855e7a014#family1#compaction#62 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:56:30,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/c7775dbdd54647028eb4e41fea98ade3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/a786fe1ee546469389ff6432f36dc756, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/64dc11b4998547b1b419143eef3dd2af, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/e503560cd6064b5d872f29dcf492850d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f323cce403f14db09d087e567db5fdcd, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/12d58e93b03b489a8f64f22c8e88d4a0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b8a29833b7474420bf9fc8f8ff4383b4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/38bffb95c2474ec28a8f9e461512c37e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f5601333afa14ba5bd56bb9aeab18376, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/538098a1f8fa483289d68b0ca1e3b8cf_SeqId_44_] to archive 2023-11-02 21:56:30,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:30,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/c7775dbdd54647028eb4e41fea98ade3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/c7775dbdd54647028eb4e41fea98ade3 2023-11-02 21:56:30,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/a786fe1ee546469389ff6432f36dc756 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/a786fe1ee546469389ff6432f36dc756 2023-11-02 21:56:30,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/64dc11b4998547b1b419143eef3dd2af to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/64dc11b4998547b1b419143eef3dd2af 2023-11-02 21:56:30,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/e503560cd6064b5d872f29dcf492850d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/e503560cd6064b5d872f29dcf492850d 2023-11-02 21:56:30,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f323cce403f14db09d087e567db5fdcd to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f323cce403f14db09d087e567db5fdcd 2023-11-02 21:56:30,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/12d58e93b03b489a8f64f22c8e88d4a0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/12d58e93b03b489a8f64f22c8e88d4a0 2023-11-02 21:56:30,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b8a29833b7474420bf9fc8f8ff4383b4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b8a29833b7474420bf9fc8f8ff4383b4 2023-11-02 21:56:30,343 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-11-02 21:56:30,344 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/38bffb95c2474ec28a8f9e461512c37e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/38bffb95c2474ec28a8f9e461512c37e 2023-11-02 21:56:30,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f5601333afa14ba5bd56bb9aeab18376 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/f5601333afa14ba5bd56bb9aeab18376 2023-11-02 21:56:30,347 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/538098a1f8fa483289d68b0ca1e3b8cf_SeqId_44_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/538098a1f8fa483289d68b0ca1e3b8cf_SeqId_44_ 2023-11-02 21:56:30,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$12(2454): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-02 21:56:30,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:30,799 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-02 21:56:30,801 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-02 21:56:30,801 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-02 21:56:30,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-02 21:56:30,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, REOPEN/MOVE}] 2023-11-02 21:56:30,810 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, REOPEN/MOVE 2023-11-02 21:56:30,812 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=12a2ddbbcd3cbf817e3db2e855e7a014, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:30,812 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962190811"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962190811"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962190811"}]},"ts":"1698962190811"} 2023-11-02 21:56:30,814 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 12a2ddbbcd3cbf817e3db2e855e7a014, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:30,966 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:30,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(111): Close 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:30,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 12a2ddbbcd3cbf817e3db2e855e7a014, disabling compactions & flushes 2023-11-02 21:56:30,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:31,545 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/.tmp/family1/fa602959b6704c27b051586a8ea5605e as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/fa602959b6704c27b051586a8ea5605e 2023-11-02 21:56:31,553 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 12a2ddbbcd3cbf817e3db2e855e7a014/family1 of 12a2ddbbcd3cbf817e3db2e855e7a014 into fa602959b6704c27b051586a8ea5605e(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:56:31,553 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:31,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:31,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:31,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. after waiting 0 ms 2023-11-02 21:56:31,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:31,553 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1698962190292; duration=1sec 2023-11-02 21:56:31,554 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:31,554 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/bb44bb8dec214759b0e6efa663df90f4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/d8140cad45f14a4d8d7a33f40e356778, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b446954d11f8404a95c544a48a419d38_SeqId_47_] to archive 2023-11-02 21:56:31,555 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:31,557 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/bb44bb8dec214759b0e6efa663df90f4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/bb44bb8dec214759b0e6efa663df90f4 2023-11-02 21:56:31,559 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/d8140cad45f14a4d8d7a33f40e356778 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/d8140cad45f14a4d8d7a33f40e356778 2023-11-02 21:56:31,561 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b446954d11f8404a95c544a48a419d38_SeqId_47_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/b446954d11f8404a95c544a48a419d38_SeqId_47_ 2023-11-02 21:56:31,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-02 21:56:31,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:31,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:31,570 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 12a2ddbbcd3cbf817e3db2e855e7a014 to self. 2023-11-02 21:56:31,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(149): Closed 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:31,572 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=12a2ddbbcd3cbf817e3db2e855e7a014, regionState=CLOSED 2023-11-02 21:56:31,573 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962191572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962191572"}]},"ts":"1698962191572"} 2023-11-02 21:56:31,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-02 21:56:31,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 12a2ddbbcd3cbf817e3db2e855e7a014, server=jenkins-hbase12.apache.org,33583,1698962105160 in 760 msec 2023-11-02 21:56:31,578 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=true 2023-11-02 21:56:31,728 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=12a2ddbbcd3cbf817e3db2e855e7a014, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:31,729 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962191728"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962191728"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962191728"}]},"ts":"1698962191728"} 2023-11-02 21:56:31,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 12a2ddbbcd3cbf817e3db2e855e7a014, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:31,884 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:31,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:31,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12a2ddbbcd3cbf817e3db2e855e7a014, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:56:31,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:31,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:31,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:31,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:31,892 INFO [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:31,893 DEBUG [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:31,893 DEBUG [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:31,894 INFO [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12a2ddbbcd3cbf817e3db2e855e7a014 columnFamilyName family1 2023-11-02 21:56:31,904 DEBUG [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/fa602959b6704c27b051586a8ea5605e 2023-11-02 21:56:31,905 INFO [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] regionserver.HStore(310): Store=12a2ddbbcd3cbf817e3db2e855e7a014/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:31,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:31,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:31,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:31,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 12a2ddbbcd3cbf817e3db2e855e7a014; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74636988, jitterRate=0.1121777892112732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:56:31,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:31,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014., pid=47, masterSystemTime=1698962191884 2023-11-02 21:56:31,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:31,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:31,918 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=12a2ddbbcd3cbf817e3db2e855e7a014, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:31,919 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962191918"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962191918"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962191918"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962191918"}]},"ts":"1698962191918"} 2023-11-02 21:56:31,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-02 21:56:31,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 12a2ddbbcd3cbf817e3db2e855e7a014, server=jenkins-hbase12.apache.org,33583,1698962105160 in 188 msec 2023-11-02 21:56:31,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-02 21:56:31,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, REOPEN/MOVE in 1.1120 sec 2023-11-02 21:56:31,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-02 21:56:31,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1180 sec 2023-11-02 21:56:31,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5380 sec 2023-11-02 21:56:31,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-02 21:56:31,928 INFO [Listener at localhost/34483] compactions.TestMobCompactor(278): alter status finished 2023-11-02 21:56:31,929 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:31,930 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-02 21:56:31,931 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-02 21:56:31,932 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962791932 2023-11-02 21:56:31,932 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:31,932 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:56:31,933 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-02 21:56:31,933 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:31,935 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x118ad353 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:56:31,988 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@351e9751, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:56:31,989 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:31,989 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:31,989 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:31,989 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:31,989 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:32,926 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112832d68275fa44450f8ea9e36f39b45fd8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112832d68275fa44450f8ea9e36f39b45fd8 2023-11-02 21:56:32,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:32,939 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:56:32,940 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:43760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:56:32,947 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:56:32,948 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:56:32,957 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7e9f808b74c14f8196fc5943f78fa21a first=Optional[r05] last=Optional[r8] 2023-11-02 21:56:32,958 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=51 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7e9f808b74c14f8196fc5943f78fa21a}] 2023-11-02 21:56:32,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7e9f808b74c14f8196fc5943f78fa21a for inclusion in 12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:32,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-02 21:56:32,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:56:32,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:32,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7e9f808b74c14f8196fc5943f78fa21a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mf03982obvur5esf0ie5bnirinuj8dphqc8h1qdg154lfhimesggd1rrch7miig8/family1/7e9f808b74c14f8196fc5943f78fa21a 2023-11-02 21:56:32,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mf03982obvur5esf0ie5bnirinuj8dphqc8h1qdg154lfhimesggd1rrch7miig8/family1/7e9f808b74c14f8196fc5943f78fa21a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/4b6b05bbe2394f71be05269cf9490966_SeqId_53_ 2023-11-02 21:56:32,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mf03982obvur5esf0ie5bnirinuj8dphqc8h1qdg154lfhimesggd1rrch7miig8/family1/7e9f808b74c14f8196fc5943f78fa21a into 12a2ddbbcd3cbf817e3db2e855e7a014/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/4b6b05bbe2394f71be05269cf9490966_SeqId_53_ - updating store file list. 2023-11-02 21:56:32,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/4b6b05bbe2394f71be05269cf9490966_SeqId_53_ into 12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:32,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mf03982obvur5esf0ie5bnirinuj8dphqc8h1qdg154lfhimesggd1rrch7miig8/family1/7e9f808b74c14f8196fc5943f78fa21a into 12a2ddbbcd3cbf817e3db2e855e7a014/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/4b6b05bbe2394f71be05269cf9490966_SeqId_53_) 2023-11-02 21:56:32,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mf03982obvur5esf0ie5bnirinuj8dphqc8h1qdg154lfhimesggd1rrch7miig8/family1/7e9f808b74c14f8196fc5943f78fa21a 2023-11-02 21:56:32,978 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:32,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:32,980 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120471536291a7149ddb569e7f329cdee17 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120471536291a7149ddb569e7f329cdee17 2023-11-02 21:56:32,982 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d980e62a13e14290bf52bd92f2a2d865 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d980e62a13e14290bf52bd92f2a2d865 2023-11-02 21:56:32,982 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-02 21:56:32,982 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-02 21:56:32,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:32,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:32,983 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:32,983 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:32,983 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:32,984 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-02 21:56:32,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.0540 sec 2023-11-02 21:56:33,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$12(2454): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-02 21:56:33,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:33,450 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-02 21:56:33,452 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-02 21:56:33,452 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-02 21:56:33,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-02 21:56:33,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, REOPEN/MOVE}] 2023-11-02 21:56:33,463 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, REOPEN/MOVE 2023-11-02 21:56:33,464 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=12a2ddbbcd3cbf817e3db2e855e7a014, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:33,465 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962193464"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962193464"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962193464"}]},"ts":"1698962193464"} 2023-11-02 21:56:33,466 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 12a2ddbbcd3cbf817e3db2e855e7a014, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:33,619 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:33,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(111): Close 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:33,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 12a2ddbbcd3cbf817e3db2e855e7a014, disabling compactions & flushes 2023-11-02 21:56:33,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:33,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:33,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. after waiting 0 ms 2023-11-02 21:56:33,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:33,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-02 21:56:33,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:33,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:33,635 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 12a2ddbbcd3cbf817e3db2e855e7a014 to self. 2023-11-02 21:56:33,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(149): Closed 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:33,638 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=12a2ddbbcd3cbf817e3db2e855e7a014, regionState=CLOSED 2023-11-02 21:56:33,638 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962193638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962193638"}]},"ts":"1698962193638"} 2023-11-02 21:56:33,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-02 21:56:33,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 12a2ddbbcd3cbf817e3db2e855e7a014, server=jenkins-hbase12.apache.org,33583,1698962105160 in 174 msec 2023-11-02 21:56:33,642 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=true 2023-11-02 21:56:33,793 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=12a2ddbbcd3cbf817e3db2e855e7a014, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:33,793 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962193793"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962193793"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962193793"}]},"ts":"1698962193793"} 2023-11-02 21:56:33,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 12a2ddbbcd3cbf817e3db2e855e7a014, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:33,947 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:33,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:33,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12a2ddbbcd3cbf817e3db2e855e7a014, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:56:33,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:33,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:33,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:33,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:33,959 INFO [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:33,961 DEBUG [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:33,962 DEBUG [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1 2023-11-02 21:56:33,962 INFO [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12a2ddbbcd3cbf817e3db2e855e7a014 columnFamilyName family1 2023-11-02 21:56:33,975 DEBUG [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/4b6b05bbe2394f71be05269cf9490966_SeqId_53_ 2023-11-02 21:56:33,980 DEBUG [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/family1/fa602959b6704c27b051586a8ea5605e 2023-11-02 21:56:33,980 INFO [StoreOpener-12a2ddbbcd3cbf817e3db2e855e7a014-1] regionserver.HStore(310): Store=12a2ddbbcd3cbf817e3db2e855e7a014/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:33,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:33,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:33,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:56:33,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 12a2ddbbcd3cbf817e3db2e855e7a014; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73049066, jitterRate=0.08851590752601624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:56:33,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:56:33,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014., pid=53, masterSystemTime=1698962193947 2023-11-02 21:56:33,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:33,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:56:33,992 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=12a2ddbbcd3cbf817e3db2e855e7a014, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:33,992 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698962193992"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962193992"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962193992"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962193992"}]},"ts":"1698962193992"} 2023-11-02 21:56:33,996 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-02 21:56:33,996 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 12a2ddbbcd3cbf817e3db2e855e7a014, server=jenkins-hbase12.apache.org,33583,1698962105160 in 199 msec 2023-11-02 21:56:33,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-02 21:56:33,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=12a2ddbbcd3cbf817e3db2e855e7a014, REOPEN/MOVE in 535 msec 2023-11-02 21:56:34,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-02 21:56:34,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 543 msec 2023-11-02 21:56:34,004 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 963 msec 2023-11-02 21:56:34,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-02 21:56:34,008 INFO [Listener at localhost/34483] compactions.TestMobCompactor(278): alter status finished 2023-11-02 21:56:34,009 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-02 21:56:34,011 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-02 21:56:34,011 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-02 21:56:34,012 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:34,012 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962794012 2023-11-02 21:56:34,012 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:56:34,013 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-02 21:56:34,013 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:34,014 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x30d6e521 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:56:34,073 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71b34875, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:56:34,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:34,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:34,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:34,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:34,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:34,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:34,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:34,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-02 21:56:34,074 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-02 21:56:34,074 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:34,078 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-02 21:56:34,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 68 msec 2023-11-02 21:56:34,141 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=250 (was 251), OpenFileDescriptor=653 (was 628) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=123 (was 171), ProcessCount=174 (was 174), AvailableMemoryMB=456 (was 474) 2023-11-02 21:56:34,152 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=250, OpenFileDescriptor=653, MaxFileDescriptor=60000, SystemLoadAverage=123, ProcessCount=174, AvailableMemoryMB=455 2023-11-02 21:56:34,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-02 21:56:34,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:34,157 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:56:34,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-02 21:56:34,157 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:56:34,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-02 21:56:34,158 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:34,159 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4 empty. 2023-11-02 21:56:34,159 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:34,159 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-02 21:56:34,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-02 21:56:34,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-02 21:56:34,570 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-02 21:56:34,572 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3ae88ad7788665b920f0d58b6cd6fbe4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:56:34,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-02 21:56:34,981 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:34,981 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 3ae88ad7788665b920f0d58b6cd6fbe4, disabling compactions & flushes 2023-11-02 21:56:34,981 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:34,981 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:34,981 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. after waiting 0 ms 2023-11-02 21:56:34,981 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:34,981 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:34,981 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:34,984 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:56:34,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962194985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962194985"}]},"ts":"1698962194985"} 2023-11-02 21:56:34,986 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-02 21:56:34,987 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:56:34,987 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962194987"}]},"ts":"1698962194987"} 2023-11-02 21:56:34,988 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-02 21:56:35,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, ASSIGN}] 2023-11-02 21:56:35,052 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, ASSIGN 2023-11-02 21:56:35,053 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:56:35,204 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=3ae88ad7788665b920f0d58b6cd6fbe4, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:35,205 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962195204"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962195204"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962195204"}]},"ts":"1698962195204"} 2023-11-02 21:56:35,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 3ae88ad7788665b920f0d58b6cd6fbe4, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:35,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-02 21:56:35,360 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:35,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:35,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ae88ad7788665b920f0d58b6cd6fbe4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:56:35,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:35,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:35,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:35,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:35,368 INFO [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:35,371 DEBUG [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:35,371 DEBUG [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:35,371 INFO [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ae88ad7788665b920f0d58b6cd6fbe4 columnFamilyName family1 2023-11-02 21:56:35,373 INFO [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] regionserver.HStore(310): Store=3ae88ad7788665b920f0d58b6cd6fbe4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:35,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:35,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:35,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:35,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:56:35,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 3ae88ad7788665b920f0d58b6cd6fbe4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68126033, jitterRate=0.015156999230384827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:56:35,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:35,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4., pid=57, masterSystemTime=1698962195360 2023-11-02 21:56:35,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:35,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:35,388 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=3ae88ad7788665b920f0d58b6cd6fbe4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:35,388 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962195387"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962195387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962195387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962195387"}]},"ts":"1698962195387"} 2023-11-02 21:56:35,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-02 21:56:35,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 3ae88ad7788665b920f0d58b6cd6fbe4, server=jenkins-hbase12.apache.org,33583,1698962105160 in 183 msec 2023-11-02 21:56:35,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-02 21:56:35,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, ASSIGN in 342 msec 2023-11-02 21:56:35,394 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:56:35,394 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962195394"}]},"ts":"1698962195394"} 2023-11-02 21:56:35,396 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-02 21:56:35,440 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:56:35,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.2860 sec 2023-11-02 21:56:36,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-02 21:56:36,267 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-02 21:56:36,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:36,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,291 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:36,292 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:36,292 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-02 21:56:36,292 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-02 21:56:36,292 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,292 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,302 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:36,302 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:36,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:36,303 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,303 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:36,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:36,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,304 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,304 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-02 21:56:36,304 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:36,304 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-02 21:56:36,304 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:36,304 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:36,304 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:36,304 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. started... 2023-11-02 21:56:36,305 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3ae88ad7788665b920f0d58b6cd6fbe4 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-02 21:56:36,722 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e014829944be409886f2fc1443d19696 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e014829944be409886f2fc1443d19696 2023-11-02 21:56:36,726 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/c5e94f402c9e4916ac238ae97cb8b03a 2023-11-02 21:56:36,731 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/c5e94f402c9e4916ac238ae97cb8b03a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c5e94f402c9e4916ac238ae97cb8b03a 2023-11-02 21:56:36,735 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c5e94f402c9e4916ac238ae97cb8b03a, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-02 21:56:36,735 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 3ae88ad7788665b920f0d58b6cd6fbe4 in 430ms, sequenceid=5, compaction requested=false 2023-11-02 21:56:36,735 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:36,736 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:36,736 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:36,736 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:36,736 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:36,736 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,736 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-02 21:56:36,736 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-02 21:56:36,786 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:36,787 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,787 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:36,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-02 21:56:36,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13526327[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:36,789 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-02 21:56:36,789 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,797 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,797 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-02 21:56:36,797 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-02 21:56:36,797 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:36,797 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,798 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:36,839 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-02 21:56:36,839 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:36,839 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-02 21:56:36,839 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:36,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:36,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-02 21:56:36,844 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-02 21:56:36,844 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:36,844 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:36,844 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,844 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:36,860 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,860 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:36,860 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:36,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:36,861 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:36,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,862 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,871 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:36,871 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:36,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:36,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:36,871 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:36,871 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:36,871 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,871 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:36,871 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,871 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:36,871 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:36,872 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:36,872 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,872 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,972 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:36,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:36,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:36,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:36,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,981 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:36,981 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:36,981 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-02 21:56:36,981 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-02 21:56:36,982 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,983 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,994 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:36,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:36,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:36,994 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,995 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:36,996 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:36,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,998 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,998 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-02 21:56:36,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:36,998 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-02 21:56:36,999 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:36,999 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-02 21:56:36,999 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:36,999 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:36,999 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:36,999 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. started... 2023-11-02 21:56:37,000 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3ae88ad7788665b920f0d58b6cd6fbe4 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-02 21:56:37,104 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:56:37,425 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128762451b84a4943138ec9dce7389d9bb5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128762451b84a4943138ec9dce7389d9bb5 2023-11-02 21:56:37,491 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30d6e521 to 127.0.0.1:49550 2023-11-02 21:56:37,491 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:56:37,492 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:56:37,492 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aa5bfdf to 127.0.0.1:49550 2023-11-02 21:56:37,492 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:56:37,492 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:56:37,492 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ff010c5 to 127.0.0.1:49550 2023-11-02 21:56:37,492 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:56:37,492 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:56:37,492 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70d0c2af to 127.0.0.1:49550 2023-11-02 21:56:37,492 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:56:37,492 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:56:37,492 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x118ad353 to 127.0.0.1:49550 2023-11-02 21:56:37,492 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:56:37,834 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/272a345f38314c6fb766cc40664efebb 2023-11-02 21:56:37,846 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/272a345f38314c6fb766cc40664efebb as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/272a345f38314c6fb766cc40664efebb 2023-11-02 21:56:37,854 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/272a345f38314c6fb766cc40664efebb, entries=1, sequenceid=9, filesize=5.0 K 2023-11-02 21:56:37,855 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 3ae88ad7788665b920f0d58b6cd6fbe4 in 855ms, sequenceid=9, compaction requested=false 2023-11-02 21:56:37,855 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:37,855 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:37,855 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:37,855 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:37,855 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:37,855 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-02 21:56:37,855 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-02 21:56:37,881 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:37,881 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:37,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:37,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:37,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:37,882 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:37,882 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:37,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:37,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:37,882 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-02 21:56:37,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:37,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:37,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:37,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-02 21:56:37,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12a5e389[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:37,883 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-02 21:56:37,883 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:37,892 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:37,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:37,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:37,892 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-02 21:56:37,892 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-02 21:56:37,892 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:37,892 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:37,892 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:37,984 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-02 21:56:37,984 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:37,984 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-02 21:56:37,984 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:37,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:37,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:37,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-02 21:56:37,989 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-02 21:56:37,989 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:37,989 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:37,989 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:37,989 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:38,047 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,047 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,048 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:38,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:38,050 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:38,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:38,055 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:38,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:38,081 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:38,081 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:38,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:38,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:38,082 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:38,082 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:38,082 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:38,082 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:38,082 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:38,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:38,082 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,083 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:38,083 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,083 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,083 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:38,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:38,183 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:38,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:38,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:38,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:38,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,191 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:38,191 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:38,191 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-02 21:56:38,191 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-02 21:56:38,192 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,192 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,197 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:38,197 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:38,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:38,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:38,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,198 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:38,198 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:38,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:38,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,199 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,200 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-02 21:56:38,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:38,200 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-02 21:56:38,200 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:38,200 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-02 21:56:38,201 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:38,201 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:38,201 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:38,201 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. started... 2023-11-02 21:56:38,201 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3ae88ad7788665b920f0d58b6cd6fbe4 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:38,621 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d4a7baf7991c4ff7865a609d9101c340 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d4a7baf7991c4ff7865a609d9101c340 2023-11-02 21:56:39,029 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/945aecd4cdf049cb861e34e544d9be6b 2023-11-02 21:56:39,041 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/945aecd4cdf049cb861e34e544d9be6b as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/945aecd4cdf049cb861e34e544d9be6b 2023-11-02 21:56:39,047 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/945aecd4cdf049cb861e34e544d9be6b, entries=1, sequenceid=13, filesize=5.0 K 2023-11-02 21:56:39,047 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3ae88ad7788665b920f0d58b6cd6fbe4 in 846ms, sequenceid=13, compaction requested=true 2023-11-02 21:56:39,048 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:39,048 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:39,048 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:39,048 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:39,048 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,048 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-02 21:56:39,048 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-02 21:56:39,103 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,103 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:39,104 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,104 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:39,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:39,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-02 21:56:39,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f9a928c[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:39,109 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-02 21:56:39,109 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,120 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,121 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-02 21:56:39,121 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-02 21:56:39,121 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:39,121 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,121 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:39,134 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,134 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-02 21:56:39,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:39,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:39,134 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:39,135 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-02 21:56:39,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:39,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:39,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:39,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:39,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-02 21:56:39,143 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-02 21:56:39,143 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:39,143 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:39,143 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,143 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:39,187 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,187 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:39,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:39,188 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:39,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:39,189 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:39,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:39,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:39,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,195 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,251 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,251 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:39,251 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-02 21:56:39,251 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:39,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:39,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:39,251 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:39,251 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:39,251 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,252 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,253 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:39,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:39,253 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:39,253 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,254 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,354 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:39,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:39,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:39,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:39,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,367 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:39,367 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:39,367 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-02 21:56:39,367 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-02 21:56:39,367 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,367 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,386 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,387 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:39,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:39,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:39,387 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:39,387 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:39,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:39,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,389 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,390 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-02 21:56:39,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:39,390 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-02 21:56:39,390 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:39,390 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-02 21:56:39,390 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:39,390 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:39,391 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:39,391 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. started... 2023-11-02 21:56:39,391 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3ae88ad7788665b920f0d58b6cd6fbe4 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:39,808 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051342af40bc674dfcafbb11140d968729 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512051342af40bc674dfcafbb11140d968729 2023-11-02 21:56:40,215 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/055795b7cfe0457e9a5198b32bcf0510 2023-11-02 21:56:40,222 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/055795b7cfe0457e9a5198b32bcf0510 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/055795b7cfe0457e9a5198b32bcf0510 2023-11-02 21:56:40,229 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/055795b7cfe0457e9a5198b32bcf0510, entries=1, sequenceid=17, filesize=5.0 K 2023-11-02 21:56:40,230 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3ae88ad7788665b920f0d58b6cd6fbe4 in 839ms, sequenceid=17, compaction requested=true 2023-11-02 21:56:40,230 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:40,230 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:40,230 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:40,230 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:40,230 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,230 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-02 21:56:40,230 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-02 21:56:40,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,281 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:40,282 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:40,282 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:40,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:40,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-02 21:56:40,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c8d469e[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:40,287 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-02 21:56:40,287 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,299 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,300 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-02 21:56:40,300 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-02 21:56:40,300 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:40,300 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,300 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:40,313 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-02 21:56:40,313 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,313 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:40,313 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-02 21:56:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:40,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:40,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:40,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:40,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:40,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-02 21:56:40,324 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-02 21:56:40,324 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:40,324 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:40,325 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,325 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:40,334 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,334 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:40,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,334 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:40,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:40,335 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,337 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,344 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:40,344 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:40,344 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:40,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:40,344 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,344 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,345 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,345 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,345 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,344 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:40,345 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:40,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:40,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:40,345 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:40,345 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:40,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:40,445 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:40,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:40,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:40,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:40,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,455 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:40,455 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:40,455 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-02 21:56:40,455 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-02 21:56:40,456 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,456 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,468 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:40,468 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:40,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:40,468 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:40,468 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:40,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,470 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,470 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-02 21:56:40,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:40,470 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-02 21:56:40,470 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:40,470 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-02 21:56:40,471 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:40,471 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:40,471 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:40,471 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. started... 2023-11-02 21:56:40,471 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3ae88ad7788665b920f0d58b6cd6fbe4 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:40,887 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285073065b15e24efeb514111b5d7e2c7b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285073065b15e24efeb514111b5d7e2c7b 2023-11-02 21:56:41,295 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/72cbdc2d8d7e40e7a073a15887c20e9f 2023-11-02 21:56:41,303 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/72cbdc2d8d7e40e7a073a15887c20e9f as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/72cbdc2d8d7e40e7a073a15887c20e9f 2023-11-02 21:56:41,311 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/72cbdc2d8d7e40e7a073a15887c20e9f, entries=1, sequenceid=21, filesize=5.0 K 2023-11-02 21:56:41,312 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3ae88ad7788665b920f0d58b6cd6fbe4 in 841ms, sequenceid=21, compaction requested=true 2023-11-02 21:56:41,312 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:41,312 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:41,312 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:41,312 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:41,312 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,312 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-02 21:56:41,312 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-02 21:56:41,323 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,323 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:41,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:41,324 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,324 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:41,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:41,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:41,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:41,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-02 21:56:41,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cc64773[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:41,325 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-02 21:56:41,325 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,334 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,334 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-02 21:56:41,334 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,334 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:41,334 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-02 21:56:41,334 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:41,344 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-02 21:56:41,344 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:41,344 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,344 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-02 21:56:41,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:41,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:41,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:41,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:41,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:41,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:41,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-02 21:56:41,346 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-02 21:56:41,347 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:41,347 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:41,347 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,347 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:41,355 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,355 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:41,355 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:41,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:41,355 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,356 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,365 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,365 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:41,365 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:41,365 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:41,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:41,365 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:41,365 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:41,365 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-02 21:56:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:41,366 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,366 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:41,366 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,366 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:41,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:41,366 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,466 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:41,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:41,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:41,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:41,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,472 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:41,472 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:41,472 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-02 21:56:41,472 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-02 21:56:41,473 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,473 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,481 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:41,481 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:41,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:41,482 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:41,482 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:41,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:41,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,482 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,483 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-02 21:56:41,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:41,483 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-02 21:56:41,483 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:41,483 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-02 21:56:41,483 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:41,483 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:41,483 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:41,483 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. started... 2023-11-02 21:56:41,483 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3ae88ad7788665b920f0d58b6cd6fbe4 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:41,905 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123111c5bd38bf1b448ebe6862bc6674b223 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123111c5bd38bf1b448ebe6862bc6674b223 2023-11-02 21:56:42,310 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/f7f356a4c9f04b0c99498a0f9c5b86e9 2023-11-02 21:56:42,317 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/f7f356a4c9f04b0c99498a0f9c5b86e9 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f7f356a4c9f04b0c99498a0f9c5b86e9 2023-11-02 21:56:42,323 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f7f356a4c9f04b0c99498a0f9c5b86e9, entries=1, sequenceid=25, filesize=5.0 K 2023-11-02 21:56:42,324 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3ae88ad7788665b920f0d58b6cd6fbe4 in 841ms, sequenceid=25, compaction requested=true 2023-11-02 21:56:42,324 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:42,324 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:42,324 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:42,324 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:42,324 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,324 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-02 21:56:42,324 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-02 21:56:42,386 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,386 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:42,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:42,387 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,387 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:42,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:42,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:42,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:42,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-02 21:56:42,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314244c9[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:42,391 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-02 21:56:42,391 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,397 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,397 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-02 21:56:42,397 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-02 21:56:42,397 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:42,398 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,398 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:42,407 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-02 21:56:42,408 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:42,408 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-02 21:56:42,407 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:42,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:42,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:42,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:42,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-02 21:56:42,417 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-02 21:56:42,417 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:42,417 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:42,418 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,418 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:42,428 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,428 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,429 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:42,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:42,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:42,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:42,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:42,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:42,430 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:42,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,434 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:42,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,449 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,449 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:42,450 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:42,449 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:42,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:42,450 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:42,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:42,450 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,450 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:42,451 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:42,450 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,451 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,451 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,451 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:42,551 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:42,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:42,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:42,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:42,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,566 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:42,567 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:42,567 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-02 21:56:42,567 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-02 21:56:42,567 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,568 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,576 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:42,576 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:42,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:42,577 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:42,577 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:42,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,579 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-02 21:56:42,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:42,579 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-02 21:56:42,579 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:42,579 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-02 21:56:42,580 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:42,580 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:42,580 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:42,580 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. started... 2023-11-02 21:56:42,580 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3ae88ad7788665b920f0d58b6cd6fbe4 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:43,001 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016fb06e6922914cf4a3dcc053d041cbda to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601016fb06e6922914cf4a3dcc053d041cbda 2023-11-02 21:56:43,411 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/f149607a91084646aebb35026734d3bd 2023-11-02 21:56:43,423 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/f149607a91084646aebb35026734d3bd as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f149607a91084646aebb35026734d3bd 2023-11-02 21:56:43,430 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f149607a91084646aebb35026734d3bd, entries=1, sequenceid=29, filesize=5.0 K 2023-11-02 21:56:43,431 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3ae88ad7788665b920f0d58b6cd6fbe4 in 851ms, sequenceid=29, compaction requested=true 2023-11-02 21:56:43,431 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:43,431 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:43,431 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:43,431 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:43,431 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,432 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-02 21:56:43,432 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-02 21:56:43,512 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,512 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:43,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:43,513 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,513 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:43,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-02 21:56:43,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a07ae9f[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:43,514 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-02 21:56:43,514 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,523 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,523 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-02 21:56:43,523 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-02 21:56:43,523 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:43,523 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,523 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:43,575 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-02 21:56:43,576 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,576 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,576 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-02 21:56:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:43,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:43,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:43,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:43,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-02 21:56:43,579 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-02 21:56:43,579 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:43,579 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:43,579 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,579 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:43,586 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,586 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,586 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:43,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:43,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:43,587 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:43,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,589 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,597 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,597 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:43,597 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,597 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,597 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:43,597 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:43,597 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:43,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:43,597 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:43,597 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-02 21:56:43,598 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:43,598 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:43,597 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:43,698 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:43,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:43,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:43,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:43,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,710 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:43,710 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:43,710 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-02 21:56:43,710 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-02 21:56:43,711 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,711 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,723 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:43,723 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:43,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:43,723 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:43,724 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:43,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:43,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,725 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,725 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-02 21:56:43,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:43,725 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-02 21:56:43,725 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:43,726 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-02 21:56:43,726 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:43,726 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:43,726 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:43,726 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. started... 2023-11-02 21:56:43,726 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3ae88ad7788665b920f0d58b6cd6fbe4 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:44,155 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f51311b88c5543c3bcd1c3a8be922a71 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103f51311b88c5543c3bcd1c3a8be922a71 2023-11-02 21:56:44,163 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/5285ab9b90184065b405f725bfcb9a3b 2023-11-02 21:56:44,170 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/5285ab9b90184065b405f725bfcb9a3b as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/5285ab9b90184065b405f725bfcb9a3b 2023-11-02 21:56:44,175 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/5285ab9b90184065b405f725bfcb9a3b, entries=1, sequenceid=33, filesize=5.0 K 2023-11-02 21:56:44,176 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3ae88ad7788665b920f0d58b6cd6fbe4 in 450ms, sequenceid=33, compaction requested=true 2023-11-02 21:56:44,176 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:44,176 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:44,176 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:44,176 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:44,176 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,176 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-02 21:56:44,176 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-02 21:56:44,262 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,262 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:44,262 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,262 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:44,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:44,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:44,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-02 21:56:44,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c58bef7[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:44,265 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-02 21:56:44,265 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,281 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-02 21:56:44,281 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-02 21:56:44,281 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:44,282 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,282 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:44,373 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-02 21:56:44,373 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:44,373 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-02 21:56:44,373 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:44,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:44,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:44,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:44,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-02 21:56:44,379 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-02 21:56:44,379 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:44,379 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:44,379 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,379 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:44,407 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,407 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,407 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:44,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:44,409 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:44,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,412 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,426 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,426 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:44,426 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:44,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:44,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:44,426 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,426 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:44,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:44,427 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:44,427 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:44,426 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:44,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:44,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,527 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:44,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:44,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:44,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:44,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,539 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:44,540 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:44,540 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-02 21:56:44,540 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-02 21:56:44,541 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,541 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,552 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:44,552 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:44,553 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,554 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:44,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:44,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,557 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,557 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-02 21:56:44,557 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:44,558 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-02 21:56:44,558 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:44,558 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-02 21:56:44,558 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:44,558 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:44,558 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:44,558 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. started... 2023-11-02 21:56:44,559 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3ae88ad7788665b920f0d58b6cd6fbe4 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:44,979 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907838212e774414cca81fc5a0548f834f4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907838212e774414cca81fc5a0548f834f4 2023-11-02 21:56:44,986 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/149bc2c2e929439789039a8b12d2b8ca 2023-11-02 21:56:44,991 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/149bc2c2e929439789039a8b12d2b8ca as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/149bc2c2e929439789039a8b12d2b8ca 2023-11-02 21:56:44,996 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/149bc2c2e929439789039a8b12d2b8ca, entries=1, sequenceid=37, filesize=5.0 K 2023-11-02 21:56:44,996 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3ae88ad7788665b920f0d58b6cd6fbe4 in 437ms, sequenceid=37, compaction requested=true 2023-11-02 21:56:44,997 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:44,997 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:44,997 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:44,997 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:44,997 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:44,997 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-02 21:56:44,997 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-02 21:56:45,049 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,049 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:45,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:45,050 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,050 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:45,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:45,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:45,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:45,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-02 21:56:45,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@221b9fd0[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:45,051 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-02 21:56:45,052 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,060 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,060 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-02 21:56:45,060 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,060 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:45,060 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-02 21:56:45,060 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:45,070 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-02 21:56:45,070 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,070 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:45,070 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-02 21:56:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:45,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-02 21:56:45,073 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-02 21:56:45,073 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:45,073 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:45,073 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,073 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:45,081 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,081 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:45,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,081 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:45,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:45,081 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,082 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,091 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,091 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:45,091 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,091 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:45,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:45,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:45,091 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:45,091 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:45,091 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,092 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,092 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:45,092 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,092 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:45,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:45,092 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:45,192 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:45,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:45,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:45,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-02 21:56:45,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,201 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:45,202 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:45,202 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-02 21:56:45,202 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-02 21:56:45,203 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,203 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,215 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:45,215 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:45,216 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,216 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:45,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,219 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,219 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-02 21:56:45,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:45,219 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-02 21:56:45,220 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:45,220 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-02 21:56:45,220 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:56:45,220 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:45,220 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:45,220 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. started... 2023-11-02 21:56:45,221 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3ae88ad7788665b920f0d58b6cd6fbe4 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:56:45,644 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207c32fe3381c34da2a7d49102f5756924 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207c32fe3381c34da2a7d49102f5756924 2023-11-02 21:56:46,050 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/20fd795992d34bffbb974cda24a6c9ee 2023-11-02 21:56:46,060 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/20fd795992d34bffbb974cda24a6c9ee as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/20fd795992d34bffbb974cda24a6c9ee 2023-11-02 21:56:46,065 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/20fd795992d34bffbb974cda24a6c9ee, entries=1, sequenceid=41, filesize=5.0 K 2023-11-02 21:56:46,066 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3ae88ad7788665b920f0d58b6cd6fbe4 in 845ms, sequenceid=41, compaction requested=true 2023-11-02 21:56:46,066 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:46,066 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:46,066 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:56:46,066 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:56:46,066 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,066 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-02 21:56:46,067 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-02 21:56:46,176 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,176 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:46,177 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,177 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:56:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:46,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:46,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-02 21:56:46,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dce356[Count = 0] remaining members to acquire global barrier 2023-11-02 21:56:46,184 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-02 21:56:46,184 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,197 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,197 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-02 21:56:46,197 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-02 21:56:46,197 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:56:46,198 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,198 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:56:46,231 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,231 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-02 21:56:46,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:46,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:46,231 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:46,232 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-02 21:56:46,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:46,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:46,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:46,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:56:46,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-02 21:56:46,241 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-02 21:56:46,241 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:56:46,241 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:56:46,241 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,241 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:56:46,260 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,260 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,260 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:56:46,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:56:46,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:56:46,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:46,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:46,262 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:56:46,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,266 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:56:46,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:46,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:56:46,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:46,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-02 21:56:46,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:56:46,281 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,281 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:56:46,282 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:46,282 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,282 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-02 21:56:46,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:56:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:56:46,282 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,282 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:56:46,283 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,383 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:56:46,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:56:46,388 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:46,391 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-02 21:56:46,393 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-02 21:56:46,394 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962806394 2023-11-02 21:56:46,394 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:46,397 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:56:46,399 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-02 21:56:46,399 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:46,400 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x4e5b28a5 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:56:46,418 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1621bfca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:56:46,419 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:47,271 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103af437291bd4c4eee95626856645dc695 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103af437291bd4c4eee95626856645dc695 2023-11-02 21:56:47,272 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:47,284 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:56:47,285 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:56:47,293 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:56:47,294 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:50274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:56:47,304 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/08abbfe4db9e43e282273d94707c746a first=Optional[r3] last=Optional[r6] 2023-11-02 21:56:47,305 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/08abbfe4db9e43e282273d94707c746a}] 2023-11-02 21:56:47,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/08abbfe4db9e43e282273d94707c746a for inclusion in 3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:47,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-02 21:56:47,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:56:47,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:47,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/08abbfe4db9e43e282273d94707c746a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r164pp7ts2d8oa524soip7q7eu5bn5smssb34ffiocht17dki6a2be00f0qbtcsg/family1/08abbfe4db9e43e282273d94707c746a 2023-11-02 21:56:47,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r164pp7ts2d8oa524soip7q7eu5bn5smssb34ffiocht17dki6a2be00f0qbtcsg/family1/08abbfe4db9e43e282273d94707c746a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c05dd870d6dc4f43949699372d236620_SeqId_44_ 2023-11-02 21:56:47,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r164pp7ts2d8oa524soip7q7eu5bn5smssb34ffiocht17dki6a2be00f0qbtcsg/family1/08abbfe4db9e43e282273d94707c746a into 3ae88ad7788665b920f0d58b6cd6fbe4/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c05dd870d6dc4f43949699372d236620_SeqId_44_ - updating store file list. 2023-11-02 21:56:47,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c05dd870d6dc4f43949699372d236620_SeqId_44_ into 3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:47,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r164pp7ts2d8oa524soip7q7eu5bn5smssb34ffiocht17dki6a2be00f0qbtcsg/family1/08abbfe4db9e43e282273d94707c746a into 3ae88ad7788665b920f0d58b6cd6fbe4/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c05dd870d6dc4f43949699372d236620_SeqId_44_) 2023-11-02 21:56:47,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r164pp7ts2d8oa524soip7q7eu5bn5smssb34ffiocht17dki6a2be00f0qbtcsg/family1/08abbfe4db9e43e282273d94707c746a 2023-11-02 21:56:47,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-02 21:56:47,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-02 21:56:47,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 3ae88ad7788665b920f0d58b6cd6fbe4/family1 is initiating minor compaction 2023-11-02 21:56:47,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@de5219e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:47,322 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3ae88ad7788665b920f0d58b6cd6fbe4/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:47,322 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/272a345f38314c6fb766cc40664efebb, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/945aecd4cdf049cb861e34e544d9be6b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/055795b7cfe0457e9a5198b32bcf0510, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/72cbdc2d8d7e40e7a073a15887c20e9f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f7f356a4c9f04b0c99498a0f9c5b86e9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f149607a91084646aebb35026734d3bd, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/5285ab9b90184065b405f725bfcb9a3b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/149bc2c2e929439789039a8b12d2b8ca, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/20fd795992d34bffbb974cda24a6c9ee, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c05dd870d6dc4f43949699372d236620_SeqId_44_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp, totalSize=50.3 K 2023-11-02 21:56:47,322 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 272a345f38314c6fb766cc40664efebb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-02 21:56:47,322 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 945aecd4cdf049cb861e34e544d9be6b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-02 21:56:47,322 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 055795b7cfe0457e9a5198b32bcf0510, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-02 21:56:47,322 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 72cbdc2d8d7e40e7a073a15887c20e9f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-02 21:56:47,323 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting f7f356a4c9f04b0c99498a0f9c5b86e9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-02 21:56:47,323 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting f149607a91084646aebb35026734d3bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-02 21:56:47,323 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 5285ab9b90184065b405f725bfcb9a3b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-02 21:56:47,323 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 149bc2c2e929439789039a8b12d2b8ca, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-02 21:56:47,323 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 20fd795992d34bffbb974cda24a6c9ee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-02 21:56:47,323 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting c05dd870d6dc4f43949699372d236620_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-02 21:56:47,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:47,324 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:47,325 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285073065b15e24efeb514111b5d7e2c7b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285073065b15e24efeb514111b5d7e2c7b 2023-11-02 21:56:47,326 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123111c5bd38bf1b448ebe6862bc6674b223 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123111c5bd38bf1b448ebe6862bc6674b223 2023-11-02 21:56:47,327 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601016fb06e6922914cf4a3dcc053d041cbda to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601016fb06e6922914cf4a3dcc053d041cbda 2023-11-02 21:56:47,328 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103f51311b88c5543c3bcd1c3a8be922a71 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103f51311b88c5543c3bcd1c3a8be922a71 2023-11-02 21:56:47,328 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-02 21:56:47,329 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-02 21:56:47,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:47,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:47,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:47,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:47,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:47,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:47,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:47,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:47,342 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3ae88ad7788665b920f0d58b6cd6fbe4#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:56:47,756 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/83e889a60bff4538a38b996d22b77f53 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/83e889a60bff4538a38b996d22b77f53 2023-11-02 21:56:47,760 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 3ae88ad7788665b920f0d58b6cd6fbe4/family1 of 3ae88ad7788665b920f0d58b6cd6fbe4 into 83e889a60bff4538a38b996d22b77f53(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:56:47,760 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:47,760 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698962207322; duration=0sec 2023-11-02 21:56:47,761 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:47,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/272a345f38314c6fb766cc40664efebb, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/945aecd4cdf049cb861e34e544d9be6b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/055795b7cfe0457e9a5198b32bcf0510, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/72cbdc2d8d7e40e7a073a15887c20e9f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f7f356a4c9f04b0c99498a0f9c5b86e9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f149607a91084646aebb35026734d3bd, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/5285ab9b90184065b405f725bfcb9a3b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/149bc2c2e929439789039a8b12d2b8ca, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/20fd795992d34bffbb974cda24a6c9ee, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c05dd870d6dc4f43949699372d236620_SeqId_44_] to archive 2023-11-02 21:56:47,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:47,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/272a345f38314c6fb766cc40664efebb to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/272a345f38314c6fb766cc40664efebb 2023-11-02 21:56:47,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/945aecd4cdf049cb861e34e544d9be6b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/945aecd4cdf049cb861e34e544d9be6b 2023-11-02 21:56:47,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/055795b7cfe0457e9a5198b32bcf0510 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/055795b7cfe0457e9a5198b32bcf0510 2023-11-02 21:56:47,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/72cbdc2d8d7e40e7a073a15887c20e9f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/72cbdc2d8d7e40e7a073a15887c20e9f 2023-11-02 21:56:47,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f7f356a4c9f04b0c99498a0f9c5b86e9 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f7f356a4c9f04b0c99498a0f9c5b86e9 2023-11-02 21:56:47,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f149607a91084646aebb35026734d3bd to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/f149607a91084646aebb35026734d3bd 2023-11-02 21:56:47,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/5285ab9b90184065b405f725bfcb9a3b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/5285ab9b90184065b405f725bfcb9a3b 2023-11-02 21:56:47,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/149bc2c2e929439789039a8b12d2b8ca to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/149bc2c2e929439789039a8b12d2b8ca 2023-11-02 21:56:47,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/20fd795992d34bffbb974cda24a6c9ee to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/20fd795992d34bffbb974cda24a6c9ee 2023-11-02 21:56:47,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c05dd870d6dc4f43949699372d236620_SeqId_44_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c05dd870d6dc4f43949699372d236620_SeqId_44_ 2023-11-02 21:56:48,166 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057e0f921f7b1b4445b63c928325f74a2d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512057e0f921f7b1b4445b63c928325f74a2d 2023-11-02 21:56:48,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:48,192 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b5aab9e56d4f4a68a961dbb2b20e0274 first=Optional[r00] last=Optional[r2] 2023-11-02 21:56:48,193 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b5aab9e56d4f4a68a961dbb2b20e0274}] 2023-11-02 21:56:48,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b5aab9e56d4f4a68a961dbb2b20e0274 for inclusion in 3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:48,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-02 21:56:48,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:56:48,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:48,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b5aab9e56d4f4a68a961dbb2b20e0274 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r8sjgum7o1vkd45rhlmvl35t013uim1o0tba4s426s9r998g8cs88hb3r0jpf89q/family1/b5aab9e56d4f4a68a961dbb2b20e0274 2023-11-02 21:56:48,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r8sjgum7o1vkd45rhlmvl35t013uim1o0tba4s426s9r998g8cs88hb3r0jpf89q/family1/b5aab9e56d4f4a68a961dbb2b20e0274 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/e294da19b4304b3abbaa7725c249dedc_SeqId_47_ 2023-11-02 21:56:48,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r8sjgum7o1vkd45rhlmvl35t013uim1o0tba4s426s9r998g8cs88hb3r0jpf89q/family1/b5aab9e56d4f4a68a961dbb2b20e0274 into 3ae88ad7788665b920f0d58b6cd6fbe4/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/e294da19b4304b3abbaa7725c249dedc_SeqId_47_ - updating store file list. 2023-11-02 21:56:48,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/e294da19b4304b3abbaa7725c249dedc_SeqId_47_ into 3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:48,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r8sjgum7o1vkd45rhlmvl35t013uim1o0tba4s426s9r998g8cs88hb3r0jpf89q/family1/b5aab9e56d4f4a68a961dbb2b20e0274 into 3ae88ad7788665b920f0d58b6cd6fbe4/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/e294da19b4304b3abbaa7725c249dedc_SeqId_47_) 2023-11-02 21:56:48,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r8sjgum7o1vkd45rhlmvl35t013uim1o0tba4s426s9r998g8cs88hb3r0jpf89q/family1/b5aab9e56d4f4a68a961dbb2b20e0274 2023-11-02 21:56:48,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-02 21:56:48,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-02 21:56:48,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 3ae88ad7788665b920f0d58b6cd6fbe4/family1 is initiating minor compaction (all files) 2023-11-02 21:56:48,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1c001198; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:48,209 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3ae88ad7788665b920f0d58b6cd6fbe4/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:48,209 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c5e94f402c9e4916ac238ae97cb8b03a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/83e889a60bff4538a38b996d22b77f53, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/e294da19b4304b3abbaa7725c249dedc_SeqId_47_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp, totalSize=388.1 K 2023-11-02 21:56:48,209 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting c5e94f402c9e4916ac238ae97cb8b03a, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878810443 2023-11-02 21:56:48,210 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 83e889a60bff4538a38b996d22b77f53, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621210443 2023-11-02 21:56:48,210 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting e294da19b4304b3abbaa7725c249dedc_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878810443 2023-11-02 21:56:48,210 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:48,211 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:48,213 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e014829944be409886f2fc1443d19696 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e014829944be409886f2fc1443d19696 2023-11-02 21:56:48,214 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d4a7baf7991c4ff7865a609d9101c340 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d4a7baf7991c4ff7865a609d9101c340 2023-11-02 21:56:48,215 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512051342af40bc674dfcafbb11140d968729 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512051342af40bc674dfcafbb11140d968729 2023-11-02 21:56:48,215 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-02 21:56:48,215 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-02 21:56:48,215 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:48,215 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:48,216 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:48,216 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-02 21:56:48,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8260 sec 2023-11-02 21:56:48,225 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3ae88ad7788665b920f0d58b6cd6fbe4#family1#compaction#74 average throughput is 25.66 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:56:48,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$12(2454): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-02 21:56:48,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:48,703 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-02 21:56:48,706 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-02 21:56:48,706 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-02 21:56:48,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-02 21:56:48,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, REOPEN/MOVE}] 2023-11-02 21:56:48,715 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, REOPEN/MOVE 2023-11-02 21:56:48,716 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=3ae88ad7788665b920f0d58b6cd6fbe4, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:48,716 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962208715"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962208715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962208715"}]},"ts":"1698962208715"} 2023-11-02 21:56:48,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 3ae88ad7788665b920f0d58b6cd6fbe4, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:48,869 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:48,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(111): Close 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:48,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 3ae88ad7788665b920f0d58b6cd6fbe4, disabling compactions & flushes 2023-11-02 21:56:48,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:49,456 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/.tmp/family1/23ee16d5e7584b9a9775bc1785d9f554 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/23ee16d5e7584b9a9775bc1785d9f554 2023-11-02 21:56:49,463 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 3ae88ad7788665b920f0d58b6cd6fbe4/family1 of 3ae88ad7788665b920f0d58b6cd6fbe4 into 23ee16d5e7584b9a9775bc1785d9f554(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:56:49,463 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:49,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:49,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:49,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. after waiting 0 ms 2023-11-02 21:56:49,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:49,463 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1698962208208; duration=1sec 2023-11-02 21:56:49,463 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:49,467 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c5e94f402c9e4916ac238ae97cb8b03a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/83e889a60bff4538a38b996d22b77f53, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/e294da19b4304b3abbaa7725c249dedc_SeqId_47_] to archive 2023-11-02 21:56:49,468 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:49,471 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c5e94f402c9e4916ac238ae97cb8b03a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/c5e94f402c9e4916ac238ae97cb8b03a 2023-11-02 21:56:49,474 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/83e889a60bff4538a38b996d22b77f53 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/83e889a60bff4538a38b996d22b77f53 2023-11-02 21:56:49,476 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/e294da19b4304b3abbaa7725c249dedc_SeqId_47_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/e294da19b4304b3abbaa7725c249dedc_SeqId_47_ 2023-11-02 21:56:49,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-02 21:56:49,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:49,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:49,483 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 3ae88ad7788665b920f0d58b6cd6fbe4 to self. 2023-11-02 21:56:49,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(149): Closed 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:49,485 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=3ae88ad7788665b920f0d58b6cd6fbe4, regionState=CLOSED 2023-11-02 21:56:49,485 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962209485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962209485"}]},"ts":"1698962209485"} 2023-11-02 21:56:49,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-02 21:56:49,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 3ae88ad7788665b920f0d58b6cd6fbe4, server=jenkins-hbase12.apache.org,33583,1698962105160 in 769 msec 2023-11-02 21:56:49,488 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=true 2023-11-02 21:56:49,638 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=3ae88ad7788665b920f0d58b6cd6fbe4, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:49,638 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962209638"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962209638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962209638"}]},"ts":"1698962209638"} 2023-11-02 21:56:49,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 3ae88ad7788665b920f0d58b6cd6fbe4, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:49,792 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:49,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:49,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ae88ad7788665b920f0d58b6cd6fbe4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:56:49,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:49,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:49,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:49,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:49,801 INFO [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:49,804 DEBUG [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:49,804 DEBUG [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:49,804 INFO [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ae88ad7788665b920f0d58b6cd6fbe4 columnFamilyName family1 2023-11-02 21:56:49,815 DEBUG [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/23ee16d5e7584b9a9775bc1785d9f554 2023-11-02 21:56:49,816 INFO [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] regionserver.HStore(310): Store=3ae88ad7788665b920f0d58b6cd6fbe4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:49,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:49,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:49,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:49,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 3ae88ad7788665b920f0d58b6cd6fbe4; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64712685, jitterRate=-0.03570584952831268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:56:49,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:49,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4., pid=63, masterSystemTime=1698962209792 2023-11-02 21:56:49,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:49,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:49,831 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=3ae88ad7788665b920f0d58b6cd6fbe4, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:49,831 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962209831"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962209831"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962209831"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962209831"}]},"ts":"1698962209831"} 2023-11-02 21:56:49,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-02 21:56:49,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 3ae88ad7788665b920f0d58b6cd6fbe4, server=jenkins-hbase12.apache.org,33583,1698962105160 in 193 msec 2023-11-02 21:56:49,836 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-02 21:56:49,836 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, REOPEN/MOVE in 1.1200 sec 2023-11-02 21:56:49,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-02 21:56:49,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1250 sec 2023-11-02 21:56:49,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5480 sec 2023-11-02 21:56:49,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-02 21:56:49,840 INFO [Listener at localhost/34483] compactions.TestMobCompactor(278): alter status finished 2023-11-02 21:56:49,841 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:49,842 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-02 21:56:49,843 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-02 21:56:49,843 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962809843 2023-11-02 21:56:49,843 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:49,844 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:56:49,844 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-02 21:56:49,845 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:49,845 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x326848ab to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:56:49,925 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68b93ed6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:56:49,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:49,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:49,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:49,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:49,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:50,763 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128036a98fe59984b158b47d9fd2c16350d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128036a98fe59984b158b47d9fd2c16350d 2023-11-02 21:56:50,764 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:50,774 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:56:50,775 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:56:50,781 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:56:50,782 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:51384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:56:50,792 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ded98a98798f4c8ea84e75a906f6eb1f first=Optional[r05] last=Optional[r8] 2023-11-02 21:56:50,793 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=51 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ded98a98798f4c8ea84e75a906f6eb1f}] 2023-11-02 21:56:50,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ded98a98798f4c8ea84e75a906f6eb1f for inclusion in 3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:50,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-02 21:56:50,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:56:50,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:50,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ded98a98798f4c8ea84e75a906f6eb1f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2vm9mo3jd118oh1eahku5qq2tsfccr9pvmfa6bh5nbrgvpefpl9mu4dapnpnah2a/family1/ded98a98798f4c8ea84e75a906f6eb1f 2023-11-02 21:56:50,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2vm9mo3jd118oh1eahku5qq2tsfccr9pvmfa6bh5nbrgvpefpl9mu4dapnpnah2a/family1/ded98a98798f4c8ea84e75a906f6eb1f as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/d1ade7536b084cc582970c146f9d1ad1_SeqId_53_ 2023-11-02 21:56:50,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2vm9mo3jd118oh1eahku5qq2tsfccr9pvmfa6bh5nbrgvpefpl9mu4dapnpnah2a/family1/ded98a98798f4c8ea84e75a906f6eb1f into 3ae88ad7788665b920f0d58b6cd6fbe4/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/d1ade7536b084cc582970c146f9d1ad1_SeqId_53_ - updating store file list. 2023-11-02 21:56:50,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/d1ade7536b084cc582970c146f9d1ad1_SeqId_53_ into 3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:50,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2vm9mo3jd118oh1eahku5qq2tsfccr9pvmfa6bh5nbrgvpefpl9mu4dapnpnah2a/family1/ded98a98798f4c8ea84e75a906f6eb1f into 3ae88ad7788665b920f0d58b6cd6fbe4/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/d1ade7536b084cc582970c146f9d1ad1_SeqId_53_) 2023-11-02 21:56:50,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2vm9mo3jd118oh1eahku5qq2tsfccr9pvmfa6bh5nbrgvpefpl9mu4dapnpnah2a/family1/ded98a98798f4c8ea84e75a906f6eb1f 2023-11-02 21:56:50,809 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:50,810 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:50,811 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207c32fe3381c34da2a7d49102f5756924 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207c32fe3381c34da2a7d49102f5756924 2023-11-02 21:56:50,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128762451b84a4943138ec9dce7389d9bb5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128762451b84a4943138ec9dce7389d9bb5 2023-11-02 21:56:50,812 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-02 21:56:50,812 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-02 21:56:50,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:50,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:50,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:50,813 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:50,813 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:50,814 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-02 21:56:50,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 972 msec 2023-11-02 21:56:50,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$12(2454): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-02 21:56:50,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:51,274 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-02 21:56:51,305 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-02 21:56:51,305 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-02 21:56:51,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-02 21:56:51,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, REOPEN/MOVE}] 2023-11-02 21:56:51,315 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, REOPEN/MOVE 2023-11-02 21:56:51,316 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=3ae88ad7788665b920f0d58b6cd6fbe4, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:51,317 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962211316"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962211316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962211316"}]},"ts":"1698962211316"} 2023-11-02 21:56:51,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 3ae88ad7788665b920f0d58b6cd6fbe4, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:51,470 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:51,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(111): Close 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:51,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 3ae88ad7788665b920f0d58b6cd6fbe4, disabling compactions & flushes 2023-11-02 21:56:51,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:51,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:51,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. after waiting 0 ms 2023-11-02 21:56:51,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:51,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-02 21:56:51,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:51,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:51,485 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 3ae88ad7788665b920f0d58b6cd6fbe4 to self. 2023-11-02 21:56:51,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(149): Closed 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:51,488 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=3ae88ad7788665b920f0d58b6cd6fbe4, regionState=CLOSED 2023-11-02 21:56:51,488 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962211488"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962211488"}]},"ts":"1698962211488"} 2023-11-02 21:56:51,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-02 21:56:51,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 3ae88ad7788665b920f0d58b6cd6fbe4, server=jenkins-hbase12.apache.org,33583,1698962105160 in 172 msec 2023-11-02 21:56:51,493 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=true 2023-11-02 21:56:51,643 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=3ae88ad7788665b920f0d58b6cd6fbe4, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:51,644 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962211643"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962211643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962211643"}]},"ts":"1698962211643"} 2023-11-02 21:56:51,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 3ae88ad7788665b920f0d58b6cd6fbe4, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:51,799 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:51,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:51,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ae88ad7788665b920f0d58b6cd6fbe4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:56:51,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:51,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:51,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:51,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:51,809 INFO [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:51,811 DEBUG [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:51,811 DEBUG [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1 2023-11-02 21:56:51,811 INFO [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ae88ad7788665b920f0d58b6cd6fbe4 columnFamilyName family1 2023-11-02 21:56:51,820 DEBUG [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/23ee16d5e7584b9a9775bc1785d9f554 2023-11-02 21:56:51,824 DEBUG [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/family1/d1ade7536b084cc582970c146f9d1ad1_SeqId_53_ 2023-11-02 21:56:51,824 INFO [StoreOpener-3ae88ad7788665b920f0d58b6cd6fbe4-1] regionserver.HStore(310): Store=3ae88ad7788665b920f0d58b6cd6fbe4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:51,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:51,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:51,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:56:51,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 3ae88ad7788665b920f0d58b6cd6fbe4; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59099473, jitterRate=-0.11934922635555267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:56:51,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:56:51,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4., pid=69, masterSystemTime=1698962211799 2023-11-02 21:56:51,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:51,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:56:51,833 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=3ae88ad7788665b920f0d58b6cd6fbe4, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:51,833 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698962211833"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962211833"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962211833"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962211833"}]},"ts":"1698962211833"} 2023-11-02 21:56:51,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-02 21:56:51,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 3ae88ad7788665b920f0d58b6cd6fbe4, server=jenkins-hbase12.apache.org,33583,1698962105160 in 188 msec 2023-11-02 21:56:51,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-02 21:56:51,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=3ae88ad7788665b920f0d58b6cd6fbe4, REOPEN/MOVE in 521 msec 2023-11-02 21:56:51,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-02 21:56:51,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 527 msec 2023-11-02 21:56:51,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 975 msec 2023-11-02 21:56:51,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-02 21:56:51,841 INFO [Listener at localhost/34483] compactions.TestMobCompactor(278): alter status finished 2023-11-02 21:56:51,842 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-02 21:56:51,843 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-02 21:56:51,844 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-02 21:56:51,844 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:51,844 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962811844 2023-11-02 21:56:51,845 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:56:51,845 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-02 21:56:51,845 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:51,846 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x0f5909fd to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:56:51,913 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45afb460, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:56:51,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:51,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:51,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:51,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:51,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:51,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:51,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:51,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-02 21:56:51,913 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-02 21:56:51,913 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:51,914 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-02 21:56:51,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 72 msec 2023-11-02 21:56:51,966 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243 (was 250), OpenFileDescriptor=643 (was 653), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=111 (was 123), ProcessCount=174 (was 174), AvailableMemoryMB=413 (was 455) 2023-11-02 21:56:51,976 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=243, OpenFileDescriptor=643, MaxFileDescriptor=60000, SystemLoadAverage=111, ProcessCount=174, AvailableMemoryMB=412 2023-11-02 21:56:51,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-02 21:56:51,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-02 21:56:51,982 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:56:51,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-02 21:56:51,982 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:56:51,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-02 21:56:51,983 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:52,104 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:56:52,104 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-02 21:56:52,105 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e5b28a5 to 127.0.0.1:49550 2023-11-02 21:56:52,105 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:56:52,105 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f5909fd to 127.0.0.1:49550 2023-11-02 21:56:52,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-02 21:56:52,105 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:56:52,105 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435 empty. 2023-11-02 21:56:52,105 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:56:52,106 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x326848ab to 127.0.0.1:49550 2023-11-02 21:56:52,106 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:56:52,106 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:52,106 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-02 21:56:52,114 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-02 21:56:52,115 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0c55b9afadcda40aa64aa2e37ca10435, NAME => 'testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:56:52,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-02 21:56:52,521 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:52,521 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 0c55b9afadcda40aa64aa2e37ca10435, disabling compactions & flushes 2023-11-02 21:56:52,521 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:52,521 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:52,521 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. after waiting 0 ms 2023-11-02 21:56:52,521 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:52,521 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:52,521 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 0c55b9afadcda40aa64aa2e37ca10435: 2023-11-02 21:56:52,524 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:56:52,525 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698962212525"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962212525"}]},"ts":"1698962212525"} 2023-11-02 21:56:52,526 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-02 21:56:52,527 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:56:52,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962212527"}]},"ts":"1698962212527"} 2023-11-02 21:56:52,528 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-02 21:56:52,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-02 21:56:52,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0c55b9afadcda40aa64aa2e37ca10435, ASSIGN}] 2023-11-02 21:56:52,675 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0c55b9afadcda40aa64aa2e37ca10435, ASSIGN 2023-11-02 21:56:52,676 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=0c55b9afadcda40aa64aa2e37ca10435, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:56:52,828 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0c55b9afadcda40aa64aa2e37ca10435, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:52,828 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698962212827"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962212827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962212827"}]},"ts":"1698962212827"} 2023-11-02 21:56:52,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 0c55b9afadcda40aa64aa2e37ca10435, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:52,981 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:52,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:52,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c55b9afadcda40aa64aa2e37ca10435, NAME => 'testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:56:52,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-02 21:56:52,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-02 21:56:52,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:52,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:52,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:52,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:52,988 INFO [StoreOpener-0c55b9afadcda40aa64aa2e37ca10435-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:52,989 DEBUG [StoreOpener-0c55b9afadcda40aa64aa2e37ca10435-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1 2023-11-02 21:56:52,989 DEBUG [StoreOpener-0c55b9afadcda40aa64aa2e37ca10435-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1 2023-11-02 21:56:52,989 INFO [StoreOpener-0c55b9afadcda40aa64aa2e37ca10435-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c55b9afadcda40aa64aa2e37ca10435 columnFamilyName f1 2023-11-02 21:56:52,991 INFO [StoreOpener-0c55b9afadcda40aa64aa2e37ca10435-1] regionserver.HStore(310): Store=0c55b9afadcda40aa64aa2e37ca10435/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:52,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:52,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:52,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:52,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:56:52,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 0c55b9afadcda40aa64aa2e37ca10435; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59361396, jitterRate=-0.11544626951217651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:56:52,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 0c55b9afadcda40aa64aa2e37ca10435: 2023-11-02 21:56:52,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435., pid=73, masterSystemTime=1698962212981 2023-11-02 21:56:52,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:52,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:52,999 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0c55b9afadcda40aa64aa2e37ca10435, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:52,999 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698962212999"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962212999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962212999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962212999"}]},"ts":"1698962212999"} 2023-11-02 21:56:53,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-02 21:56:53,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 0c55b9afadcda40aa64aa2e37ca10435, server=jenkins-hbase12.apache.org,33583,1698962105160 in 171 msec 2023-11-02 21:56:53,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-02 21:56:53,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=0c55b9afadcda40aa64aa2e37ca10435, ASSIGN in 331 msec 2023-11-02 21:56:53,002 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:56:53,002 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962213002"}]},"ts":"1698962213002"} 2023-11-02 21:56:53,003 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-02 21:56:53,015 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:56:53,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.0360 sec 2023-11-02 21:56:53,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-02 21:56:53,111 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-02 21:56:53,111 DEBUG [Listener at localhost/34483] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-02 21:56:53,114 INFO [Listener at localhost/34483] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-02 21:56:53,119 INFO [Listener at localhost/34483] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-02 21:56:53,119 INFO [Listener at localhost/34483] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-02 21:56:53,120 INFO [Listener at localhost/34483] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-02 21:56:53,125 INFO [Listener at localhost/34483] regionserver.HRegion(2745): Flushing 0c55b9afadcda40aa64aa2e37ca10435 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-02 21:56:53,543 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311026745f3a576e5424ba10874e78af7bc58 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311026745f3a576e5424ba10874e78af7bc58 2023-11-02 21:56:53,949 INFO [Listener at localhost/34483] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/.tmp/f1/8c1728bc87624d05a004f4d3742aebdc 2023-11-02 21:56:53,953 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/.tmp/f1/8c1728bc87624d05a004f4d3742aebdc as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc 2023-11-02 21:56:53,957 INFO [Listener at localhost/34483] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc, entries=1, sequenceid=5, filesize=4.9 K 2023-11-02 21:56:53,958 INFO [Listener at localhost/34483] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 0c55b9afadcda40aa64aa2e37ca10435 in 833ms, sequenceid=5, compaction requested=false 2023-11-02 21:56:53,958 DEBUG [Listener at localhost/34483] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-02 21:56:53,958 DEBUG [Listener at localhost/34483] regionserver.HRegion(2446): Flush status journal for 0c55b9afadcda40aa64aa2e37ca10435: 2023-11-02 21:56:53,960 INFO [Listener at localhost/34483] regionserver.HRegion(2745): Flushing 0c55b9afadcda40aa64aa2e37ca10435 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-02 21:56:54,094 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-02 21:56:54,094 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-11-02 21:56:54,371 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311022448b1f86dd44e5291aac1dd1b56763c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311022448b1f86dd44e5291aac1dd1b56763c 2023-11-02 21:56:54,777 INFO [Listener at localhost/34483] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/.tmp/f1/e13e47b1287b4ce5abb511bb66ca82a0 2023-11-02 21:56:54,788 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/.tmp/f1/e13e47b1287b4ce5abb511bb66ca82a0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0 2023-11-02 21:56:54,795 INFO [Listener at localhost/34483] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0, entries=1, sequenceid=9, filesize=4.9 K 2023-11-02 21:56:54,796 INFO [Listener at localhost/34483] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 0c55b9afadcda40aa64aa2e37ca10435 in 836ms, sequenceid=9, compaction requested=false 2023-11-02 21:56:54,796 DEBUG [Listener at localhost/34483] regionserver.HRegion(2446): Flush status journal for 0c55b9afadcda40aa64aa2e37ca10435: 2023-11-02 21:56:54,798 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-02 21:56:54,799 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-02 21:56:54,800 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-02 21:56:54,800 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962814800 2023-11-02 21:56:54,800 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:54,801 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-02 21:56:54,801 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-02 21:56:54,801 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-02 21:56:54,803 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x55b0fed4 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:56:54,850 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:54,850 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:54,882 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d845cb6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:56:54,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231102 for table='testGetAfterCompaction' and column='f1' 2023-11-02 21:56:54,900 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:54,901 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:54,952 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:54,952 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,002 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,003 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,016 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:56:55,053 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,054 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,104 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,104 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,155 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,155 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,206 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,207 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,258 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,259 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,310 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,310 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,361 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,361 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,413 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,413 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,464 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,464 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,516 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,516 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,568 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,568 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,620 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,620 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,671 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,672 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,721 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102c09ea9dff9114305be436b623f326681 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231102c09ea9dff9114305be436b623f326681 2023-11-02 21:56:55,722 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,722 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231102 table='testGetAfterCompaction' column='f1' 2023-11-02 21:56:55,737 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:56:55,738 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:56:55,743 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:56:55,745 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:51394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:56:55,754 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231102/f1/d6b740d6376046c2b4d23c61494a494c first=Optional[r1] last=Optional[r2] 2023-11-02 21:56:55,754 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{f1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231102/f1/d6b740d6376046c2b4d23c61494a494c}] 2023-11-02 21:56:55,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231102/f1/d6b740d6376046c2b4d23c61494a494c for inclusion in 0c55b9afadcda40aa64aa2e37ca10435/f1 2023-11-02 21:56:55,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-02 21:56:55,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:56:55,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 0c55b9afadcda40aa64aa2e37ca10435: 2023-11-02 21:56:55,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231102/f1/d6b740d6376046c2b4d23c61494a494c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testGetAfterCompaction__vrspaccl6f9mbpfh0u7b03a23j263gvki4tc6tsrjtddsvc936oetm6c0sntoa88/f1/d6b740d6376046c2b4d23c61494a494c 2023-11-02 21:56:55,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testGetAfterCompaction__vrspaccl6f9mbpfh0u7b03a23j263gvki4tc6tsrjtddsvc936oetm6c0sntoa88/f1/d6b740d6376046c2b4d23c61494a494c as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_ 2023-11-02 21:56:55,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testGetAfterCompaction__vrspaccl6f9mbpfh0u7b03a23j263gvki4tc6tsrjtddsvc936oetm6c0sntoa88/f1/d6b740d6376046c2b4d23c61494a494c into 0c55b9afadcda40aa64aa2e37ca10435/f1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_ - updating store file list. 2023-11-02 21:56:55,773 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,773 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:55,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_ into 0c55b9afadcda40aa64aa2e37ca10435/f1 2023-11-02 21:56:55,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testGetAfterCompaction__vrspaccl6f9mbpfh0u7b03a23j263gvki4tc6tsrjtddsvc936oetm6c0sntoa88/f1/d6b740d6376046c2b4d23c61494a494c into 0c55b9afadcda40aa64aa2e37ca10435/f1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_) 2023-11-02 21:56:55,773 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testGetAfterCompaction__vrspaccl6f9mbpfh0u7b03a23j263gvki4tc6tsrjtddsvc936oetm6c0sntoa88/f1/d6b740d6376046c2b4d23c61494a494c 2023-11-02 21:56:55,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 0c55b9afadcda40aa64aa2e37ca10435/f1 is initiating minor compaction 2023-11-02 21:56:55,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@ea9a504; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:55,775 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0c55b9afadcda40aa64aa2e37ca10435/f1 in testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:55,775 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/.tmp, totalSize=10.0 K 2023-11-02 21:56:55,775 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting e13e47b1287b4ce5abb511bb66ca82a0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-02 21:56:55,775 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 90f8718a8b554a12861cc71f5e0c1402_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-02 21:56:55,778 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231102 table='testGetAfterCompaction' column='f1' 2023-11-02 21:56:55,779 DEBUG [Listener at localhost/34483] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-02 21:56:55,779 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:55,783 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311022448b1f86dd44e5291aac1dd1b56763c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311022448b1f86dd44e5291aac1dd1b56763c 2023-11-02 21:56:55,783 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-02 21:56:55,784 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33583] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:55,784 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-02 21:56:55,784 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-02 21:56:55,784 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33583] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-02 21:56:55,785 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33583] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. because compaction request was cancelled 2023-11-02 21:56:55,785 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311026745f3a576e5424ba10874e78af7bc58 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311026745f3a576e5424ba10874e78af7bc58 2023-11-02 21:56:55,785 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-02 21:56:55,785 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231102' 2023-11-02 21:56:55,786 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231102 for table='testGetAfterCompaction' and column='f1' 2023-11-02 21:56:55,786 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-02 21:56:55,786 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:56:55,787 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-02 21:56:55,787 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0c55b9afadcda40aa64aa2e37ca10435#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:56:55,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 989 msec 2023-11-02 21:56:55,836 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,836 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:55,836 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,887 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,887 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:55,887 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,938 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,938 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:55,938 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,989 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:55,989 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:55,989 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,040 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,040 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,040 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,091 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,092 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,092 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,143 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,143 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,143 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,194 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,194 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,194 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,245 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,245 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,245 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,296 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,296 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,296 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,347 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,347 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,347 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,399 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,399 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,399 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,451 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,451 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,451 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,502 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,502 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,502 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,568 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,568 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,568 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,602 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/.tmp/f1/9f3c6d2d670e49fb81b3801e4dc6d348 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/9f3c6d2d670e49fb81b3801e4dc6d348 2023-11-02 21:56:56,607 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 0c55b9afadcda40aa64aa2e37ca10435/f1 of 0c55b9afadcda40aa64aa2e37ca10435 into 9f3c6d2d670e49fb81b3801e4dc6d348(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:56:56,607 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0c55b9afadcda40aa64aa2e37ca10435: 2023-11-02 21:56:56,607 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1698962215774; duration=0sec 2023-11-02 21:56:56,607 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:56:56,619 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,619 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,619 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/9f3c6d2d670e49fb81b3801e4dc6d348; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698962216598; access_time=1698962215784; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,619 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,670 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,670 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,670 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/9f3c6d2d670e49fb81b3801e4dc6d348; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698962216598; access_time=1698962215784; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,670 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_] to archive 2023-11-02 21:56:56,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:56:56,721 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,721 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698962215717; access_time=1698962214905; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-02 21:56:56,721 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/9f3c6d2d670e49fb81b3801e4dc6d348; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698962216598; access_time=1698962215784; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,721 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962214777; access_time=1698962213962; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/e13e47b1287b4ce5abb511bb66ca82a0 2023-11-02 21:56:56,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/90f8718a8b554a12861cc71f5e0c1402_SeqId_12_ 2023-11-02 21:56:56,772 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698962213949; access_time=1698962213128; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,772 INFO [Listener at localhost/34483] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/9f3c6d2d670e49fb81b3801e4dc6d348; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698962216598; access_time=1698962215784; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-02 21:56:56,895 INFO [Listener at localhost/34483] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-02 21:56:56,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$11(2418): Client=jenkins//136.243.104.168 disable testGetAfterCompaction 2023-11-02 21:56:56,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-02 21:56:56,907 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962216907"}]},"ts":"1698962216907"} 2023-11-02 21:56:56,908 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-02 21:56:56,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-02 21:56:56,922 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-02 21:56:56,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0c55b9afadcda40aa64aa2e37ca10435, UNASSIGN}] 2023-11-02 21:56:56,925 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0c55b9afadcda40aa64aa2e37ca10435, UNASSIGN 2023-11-02 21:56:56,926 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0c55b9afadcda40aa64aa2e37ca10435, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:56,926 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698962216926"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962216926"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962216926"}]},"ts":"1698962216926"} 2023-11-02 21:56:56,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 0c55b9afadcda40aa64aa2e37ca10435, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:57,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-02 21:56:57,079 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:57,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(111): Close 0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:57,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 0c55b9afadcda40aa64aa2e37ca10435, disabling compactions & flushes 2023-11-02 21:56:57,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:57,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:57,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. after waiting 0 ms 2023-11-02 21:56:57,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:57,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-02 21:56:57,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-02 21:56:57,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435. 2023-11-02 21:56:57,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 0c55b9afadcda40aa64aa2e37ca10435: 2023-11-02 21:56:57,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(149): Closed 0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:57,090 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0c55b9afadcda40aa64aa2e37ca10435, regionState=CLOSED 2023-11-02 21:56:57,091 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698962217090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962217090"}]},"ts":"1698962217090"} 2023-11-02 21:56:57,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-02 21:56:57,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 0c55b9afadcda40aa64aa2e37ca10435, server=jenkins-hbase12.apache.org,33583,1698962105160 in 164 msec 2023-11-02 21:56:57,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-02 21:56:57,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=0c55b9afadcda40aa64aa2e37ca10435, UNASSIGN in 169 msec 2023-11-02 21:56:57,095 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962217095"}]},"ts":"1698962217095"} 2023-11-02 21:56:57,096 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-02 21:56:57,109 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-02 21:56:57,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 209 msec 2023-11-02 21:56:57,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-02 21:56:57,211 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-02 21:56:57,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$5(2228): Client=jenkins//136.243.104.168 delete testGetAfterCompaction 2023-11-02 21:56:57,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-02 21:56:57,227 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-02 21:56:57,229 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-02 21:56:57,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-02 21:56:57,231 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:57,233 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1, FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/recovered.edits] 2023-11-02 21:56:57,237 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/8c1728bc87624d05a004f4d3742aebdc 2023-11-02 21:56:57,238 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/9f3c6d2d670e49fb81b3801e4dc6d348 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/f1/9f3c6d2d670e49fb81b3801e4dc6d348 2023-11-02 21:56:57,240 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/recovered.edits/15.seqid to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435/recovered.edits/15.seqid 2023-11-02 21:56:57,241 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testGetAfterCompaction/0c55b9afadcda40aa64aa2e37ca10435 2023-11-02 21:56:57,241 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-02 21:56:57,241 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-02 21:56:57,241 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-02 21:56:57,244 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231102c09ea9dff9114305be436b623f326681 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231102c09ea9dff9114305be436b623f326681 2023-11-02 21:56:57,244 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-02 21:56:57,246 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-02 21:56:57,270 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-02 21:56:57,273 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-02 21:56:57,274 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-02 21:56:57,274 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-02 21:56:57,275 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698962217274"}]},"ts":"9223372036854775807"} 2023-11-02 21:56:57,276 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-02 21:56:57,276 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0c55b9afadcda40aa64aa2e37ca10435, NAME => 'testGetAfterCompaction,,1698962211979.0c55b9afadcda40aa64aa2e37ca10435.', STARTKEY => '', ENDKEY => ''}] 2023-11-02 21:56:57,276 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-02 21:56:57,276 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1698962217276"}]},"ts":"9223372036854775807"} 2023-11-02 21:56:57,278 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-02 21:56:57,291 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-02 21:56:57,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 69 msec 2023-11-02 21:56:57,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-02 21:56:57,331 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-02 21:56:57,345 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239 (was 243), OpenFileDescriptor=628 (was 643), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=102 (was 111), ProcessCount=174 (was 174), AvailableMemoryMB=311 (was 412) 2023-11-02 21:56:57,355 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=239, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=102, ProcessCount=174, AvailableMemoryMB=311 2023-11-02 21:56:57,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-02 21:56:57,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-02 21:56:57,359 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:56:57,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-02 21:56:57,360 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:56:57,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-02 21:56:57,362 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:56:57,362 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:56:57,362 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5 2023-11-02 21:56:57,363 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c empty. 2023-11-02 21:56:57,363 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5 empty. 2023-11-02 21:56:57,363 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1 empty. 2023-11-02 21:56:57,363 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:56:57,363 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5 2023-11-02 21:56:57,363 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:56:57,363 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-02 21:56:57,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-02 21:56:57,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-02 21:56:57,777 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-02 21:56:57,779 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8cb793f0a9b02d274d44d3bfb0a21f4c, NAME => 'testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:56:57,779 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 454cd05942026638919fcedce9e68ca5, NAME => 'testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:56:57,779 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => e92d97a5fce63a593b6e19d1ce049ed1, NAME => 'testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:56:57,789 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:57,790 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing e92d97a5fce63a593b6e19d1ce049ed1, disabling compactions & flushes 2023-11-02 21:56:57,790 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:56:57,790 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:56:57,790 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. after waiting 0 ms 2023-11-02 21:56:57,790 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:56:57,790 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:56:57,790 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:56:57,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-02 21:56:58,188 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:58,188 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:58,188 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 8cb793f0a9b02d274d44d3bfb0a21f4c, disabling compactions & flushes 2023-11-02 21:56:58,188 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 454cd05942026638919fcedce9e68ca5, disabling compactions & flushes 2023-11-02 21:56:58,188 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:56:58,189 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:56:58,189 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:56:58,189 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. after waiting 0 ms 2023-11-02 21:56:58,189 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:56:58,189 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:56:58,189 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:56:58,189 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. after waiting 0 ms 2023-11-02 21:56:58,189 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:56:58,189 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:56:58,189 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:56:58,189 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:56:58,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:56:58,193 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962218193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962218193"}]},"ts":"1698962218193"} 2023-11-02 21:56:58,193 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962218193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962218193"}]},"ts":"1698962218193"} 2023-11-02 21:56:58,193 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962218193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962218193"}]},"ts":"1698962218193"} 2023-11-02 21:56:58,196 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-02 21:56:58,197 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:56:58,197 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962218197"}]},"ts":"1698962218197"} 2023-11-02 21:56:58,198 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-02 21:56:58,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, ASSIGN}] 2023-11-02 21:56:58,275 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, ASSIGN 2023-11-02 21:56:58,275 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, ASSIGN 2023-11-02 21:56:58,276 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, ASSIGN 2023-11-02 21:56:58,277 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:56:58,277 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:56:58,277 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:56:58,429 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=454cd05942026638919fcedce9e68ca5, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:58,429 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e92d97a5fce63a593b6e19d1ce049ed1, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:58,429 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=8cb793f0a9b02d274d44d3bfb0a21f4c, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:58,430 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962218429"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962218429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962218429"}]},"ts":"1698962218429"} 2023-11-02 21:56:58,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962218429"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962218429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962218429"}]},"ts":"1698962218429"} 2023-11-02 21:56:58,430 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962218429"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962218429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962218429"}]},"ts":"1698962218429"} 2023-11-02 21:56:58,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure e92d97a5fce63a593b6e19d1ce049ed1, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:58,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 8cb793f0a9b02d274d44d3bfb0a21f4c, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:58,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 454cd05942026638919fcedce9e68ca5, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:56:58,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-02 21:56:58,586 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:58,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:56:58,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8cb793f0a9b02d274d44d3bfb0a21f4c, NAME => 'testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.', STARTKEY => '', ENDKEY => '1'} 2023-11-02 21:56:58,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:56:58,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:58,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:56:58,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:56:58,597 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:56:58,599 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1 2023-11-02 21:56:58,600 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1 2023-11-02 21:56:58,600 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb793f0a9b02d274d44d3bfb0a21f4c columnFamilyName family1 2023-11-02 21:56:58,601 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(310): Store=8cb793f0a9b02d274d44d3bfb0a21f4c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:58,601 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:56:58,602 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2 2023-11-02 21:56:58,602 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2 2023-11-02 21:56:58,603 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb793f0a9b02d274d44d3bfb0a21f4c columnFamilyName family2 2023-11-02 21:56:58,604 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(310): Store=8cb793f0a9b02d274d44d3bfb0a21f4c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:58,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:56:58,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:56:58,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:56:58,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:56:58,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:56:58,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 8cb793f0a9b02d274d44d3bfb0a21f4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70947231, jitterRate=0.05719612538814545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:56:58,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:56:58,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c., pid=84, masterSystemTime=1698962218586 2023-11-02 21:56:58,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:56:58,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:56:58,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:56:58,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 454cd05942026638919fcedce9e68ca5, NAME => 'testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.', STARTKEY => '2', ENDKEY => ''} 2023-11-02 21:56:58,611 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=8cb793f0a9b02d274d44d3bfb0a21f4c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:58,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 454cd05942026638919fcedce9e68ca5 2023-11-02 21:56:58,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:58,611 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962218611"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962218611"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962218611"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962218611"}]},"ts":"1698962218611"} 2023-11-02 21:56:58,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 454cd05942026638919fcedce9e68ca5 2023-11-02 21:56:58,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 454cd05942026638919fcedce9e68ca5 2023-11-02 21:56:58,613 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 454cd05942026638919fcedce9e68ca5 2023-11-02 21:56:58,614 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1 2023-11-02 21:56:58,614 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1 2023-11-02 21:56:58,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=80 2023-11-02 21:56:58,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 8cb793f0a9b02d274d44d3bfb0a21f4c, server=jenkins-hbase12.apache.org,33583,1698962105160 in 181 msec 2023-11-02 21:56:58,615 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 454cd05942026638919fcedce9e68ca5 columnFamilyName family1 2023-11-02 21:56:58,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, ASSIGN in 344 msec 2023-11-02 21:56:58,615 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(310): Store=454cd05942026638919fcedce9e68ca5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:58,616 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 454cd05942026638919fcedce9e68ca5 2023-11-02 21:56:58,617 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2 2023-11-02 21:56:58,617 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2 2023-11-02 21:56:58,617 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 454cd05942026638919fcedce9e68ca5 columnFamilyName family2 2023-11-02 21:56:58,618 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(310): Store=454cd05942026638919fcedce9e68ca5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:58,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5 2023-11-02 21:56:58,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5 2023-11-02 21:56:58,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:56:58,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 454cd05942026638919fcedce9e68ca5 2023-11-02 21:56:58,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:56:58,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 454cd05942026638919fcedce9e68ca5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73818957, jitterRate=0.0999881774187088}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:56:58,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:56:58,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5., pid=85, masterSystemTime=1698962218586 2023-11-02 21:56:58,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:56:58,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:56:58,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:56:58,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e92d97a5fce63a593b6e19d1ce049ed1, NAME => 'testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.', STARTKEY => '1', ENDKEY => '2'} 2023-11-02 21:56:58,627 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=454cd05942026638919fcedce9e68ca5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:58,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:56:58,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:56:58,627 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962218627"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962218627"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962218627"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962218627"}]},"ts":"1698962218627"} 2023-11-02 21:56:58,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:56:58,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:56:58,628 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:56:58,630 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1 2023-11-02 21:56:58,630 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1 2023-11-02 21:56:58,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=82 2023-11-02 21:56:58,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 454cd05942026638919fcedce9e68ca5, server=jenkins-hbase12.apache.org,33583,1698962105160 in 195 msec 2023-11-02 21:56:58,630 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e92d97a5fce63a593b6e19d1ce049ed1 columnFamilyName family1 2023-11-02 21:56:58,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, ASSIGN in 358 msec 2023-11-02 21:56:58,631 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(310): Store=e92d97a5fce63a593b6e19d1ce049ed1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:58,632 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:56:58,633 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2 2023-11-02 21:56:58,633 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2 2023-11-02 21:56:58,634 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e92d97a5fce63a593b6e19d1ce049ed1 columnFamilyName family2 2023-11-02 21:56:58,635 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(310): Store=e92d97a5fce63a593b6e19d1ce049ed1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:56:58,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:56:58,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:56:58,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:56:58,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:56:58,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:56:58,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened e92d97a5fce63a593b6e19d1ce049ed1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67264901, jitterRate=0.0023251324892044067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:56:58,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:56:58,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1., pid=83, masterSystemTime=1698962218586 2023-11-02 21:56:58,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:56:58,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:56:58,642 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e92d97a5fce63a593b6e19d1ce049ed1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:58,643 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962218642"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962218642"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962218642"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962218642"}]},"ts":"1698962218642"} 2023-11-02 21:56:58,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=81 2023-11-02 21:56:58,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure e92d97a5fce63a593b6e19d1ce049ed1, server=jenkins-hbase12.apache.org,33583,1698962105160 in 212 msec 2023-11-02 21:56:58,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=79 2023-11-02 21:56:58,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, ASSIGN in 375 msec 2023-11-02 21:56:58,647 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:56:58,647 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962218647"}]},"ts":"1698962218647"} 2023-11-02 21:56:58,648 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-02 21:56:58,703 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:56:58,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.3460 sec 2023-11-02 21:56:59,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-02 21:56:59,470 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-02 21:56:59,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:56:59,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:56:59,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:56:59,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:56:59,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-02 21:56:59,487 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-02 21:56:59,487 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:59,487 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-02 21:56:59,487 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-02 21:56:59,488 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:56:59,488 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:56:59,532 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:59,532 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:56:59,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:56:59,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:56:59,533 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:56:59,533 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:56:59,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:56:59,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:56:59,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:56:59,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:56:59,536 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-02 21:56:59,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-02 21:56:59,536 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-02 21:56:59,536 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:56:59,536 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-02 21:56:59,537 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:56:59,537 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. started... 2023-11-02 21:56:59,537 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:56:59,537 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. started... 2023-11-02 21:56:59,538 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:56:59,538 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e92d97a5fce63a593b6e19d1ce049ed1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-02 21:56:59,537 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:56:59,539 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:56:59,539 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8cb793f0a9b02d274d44d3bfb0a21f4c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-02 21:56:59,539 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. started... 2023-11-02 21:56:59,540 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 454cd05942026638919fcedce9e68ca5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-02 21:56:59,963 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102acd189c881b648719a86dcf5141355e3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102acd189c881b648719a86dcf5141355e3 2023-11-02 21:56:59,963 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311025424dd532c8c4e389d9d631213d584fd to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311025424dd532c8c4e389d9d631213d584fd 2023-11-02 21:56:59,963 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102221d5173092c40dbb3e3968cd4b64c3b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102221d5173092c40dbb3e3968cd4b64c3b 2023-11-02 21:56:59,975 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/5c7167f400834f81aeb00a99432501a4 2023-11-02 21:57:00,376 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/2e237e52069c459b870bb650ad8b650c 2023-11-02 21:57:00,376 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/787fcae96a10496a81fcf126814cf8af 2023-11-02 21:57:00,392 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102862cb5e4d7254e3cb1cd5b14759bb7e7 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102862cb5e4d7254e3cb1cd5b14759bb7e7 2023-11-02 21:57:00,798 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/4d756e51562648fdb2cf3e7190f433e2 2023-11-02 21:57:00,806 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311020578b0d06f4047ceb7f6a3f8b21f5407 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020578b0d06f4047ceb7f6a3f8b21f5407 2023-11-02 21:57:00,806 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311027684f3496d354d02ac06d38a0398456d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311027684f3496d354d02ac06d38a0398456d 2023-11-02 21:57:00,807 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/5c7167f400834f81aeb00a99432501a4 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/5c7167f400834f81aeb00a99432501a4 2023-11-02 21:57:00,814 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/5c7167f400834f81aeb00a99432501a4, entries=4, sequenceid=5, filesize=5.4 K 2023-11-02 21:57:00,814 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/4d756e51562648fdb2cf3e7190f433e2 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/4d756e51562648fdb2cf3e7190f433e2 2023-11-02 21:57:00,818 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/4d756e51562648fdb2cf3e7190f433e2, entries=2, sequenceid=5, filesize=5.1 K 2023-11-02 21:57:00,819 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e92d97a5fce63a593b6e19d1ce049ed1 in 1281ms, sequenceid=5, compaction requested=false 2023-11-02 21:57:00,819 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-02 21:57:00,820 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:00,820 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:00,820 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:57:01,214 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/c0441b139ac644c78bfc0e67b12841ca 2023-11-02 21:57:01,214 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/9323316882f34a2c94235b58ef89c8e0 2023-11-02 21:57:01,222 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/2e237e52069c459b870bb650ad8b650c as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/2e237e52069c459b870bb650ad8b650c 2023-11-02 21:57:01,222 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/787fcae96a10496a81fcf126814cf8af as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/787fcae96a10496a81fcf126814cf8af 2023-11-02 21:57:01,226 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/2e237e52069c459b870bb650ad8b650c, entries=4, sequenceid=5, filesize=5.4 K 2023-11-02 21:57:01,226 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/787fcae96a10496a81fcf126814cf8af, entries=4, sequenceid=5, filesize=5.4 K 2023-11-02 21:57:01,227 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/9323316882f34a2c94235b58ef89c8e0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/9323316882f34a2c94235b58ef89c8e0 2023-11-02 21:57:01,227 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/c0441b139ac644c78bfc0e67b12841ca as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c0441b139ac644c78bfc0e67b12841ca 2023-11-02 21:57:01,231 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/9323316882f34a2c94235b58ef89c8e0, entries=2, sequenceid=5, filesize=5.1 K 2023-11-02 21:57:01,231 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c0441b139ac644c78bfc0e67b12841ca, entries=2, sequenceid=5, filesize=5.1 K 2023-11-02 21:57:01,231 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8cb793f0a9b02d274d44d3bfb0a21f4c in 1692ms, sequenceid=5, compaction requested=false 2023-11-02 21:57:01,231 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 454cd05942026638919fcedce9e68ca5 in 1691ms, sequenceid=5, compaction requested=false 2023-11-02 21:57:01,232 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:01,232 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:01,232 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:01,232 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:01,232 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:57:01,232 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:57:01,232 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:57:01,232 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,232 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-02 21:57:01,232 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-02 21:57:01,301 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,301 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:01,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:01,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:01,302 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:01,303 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:01,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:01,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:01,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:01,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:01,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-02 21:57:01,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4668c6a4[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:01,307 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-02 21:57:01,307 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:01,319 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:01,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:01,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:01,320 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-02 21:57:01,320 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-02 21:57:01,320 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:01,320 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,320 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:01,332 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-02 21:57:01,332 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,332 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:01,333 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-02 21:57:01,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:01,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:01,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:01,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:01,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:01,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:01,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:01,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:01,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-02 21:57:01,341 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-02 21:57:01,342 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:01,342 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:01,342 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-02 21:57:01,342 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:01,353 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:01,353 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:01,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:01,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:01,354 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:01,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:01,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:01,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:01,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:01,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:01,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:01,355 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:01,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:01,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:01,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:01,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,359 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:01,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:01,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:01,375 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:01,375 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:01,375 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:01,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-02 21:57:01,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:01,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:01,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:01,375 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:01,376 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,376 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:01,376 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:01,376 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:01,376 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:01,377 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:01,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:01,476 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:01,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:01,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:01,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:01,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:01,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:01,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:01,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-02 21:57:01,492 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-02 21:57:01,492 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:01,492 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-02 21:57:01,492 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-02 21:57:01,493 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:01,493 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:01,531 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,531 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:01,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:01,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:01,532 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:01,532 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:01,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:01,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:01,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:01,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:01,532 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-02 21:57:01,533 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-02 21:57:01,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-02 21:57:01,533 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-02 21:57:01,533 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:01,533 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-02 21:57:01,533 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:01,533 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:01,533 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. started... 2023-11-02 21:57:01,533 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:57:01,533 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:01,533 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:01,533 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. started... 2023-11-02 21:57:01,533 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. started... 2023-11-02 21:57:01,533 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e92d97a5fce63a593b6e19d1ce049ed1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-02 21:57:01,533 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 454cd05942026638919fcedce9e68ca5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-02 21:57:01,533 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8cb793f0a9b02d274d44d3bfb0a21f4c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-02 21:57:01,952 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311026cec23cd08644e39a32214fd597f0ad4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311026cec23cd08644e39a32214fd597f0ad4 2023-11-02 21:57:01,952 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102b634842f9dea468cbd0ec0ec91e6acdc to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102b634842f9dea468cbd0ec0ec91e6acdc 2023-11-02 21:57:01,952 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102a0534c275a1c47c0bc70f6b61a693598 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102a0534c275a1c47c0bc70f6b61a693598 2023-11-02 21:57:02,360 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/e3c0e2e20b12497081e3718420251a17 2023-11-02 21:57:02,360 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/3032660c3acd4a088d38f7119b15add6 2023-11-02 21:57:02,360 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/3a77396452e949bdaa031b39ff65c846 2023-11-02 21:57:02,592 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:57:02,783 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311022820230baffa4682a6c94031f4ab21af to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311022820230baffa4682a6c94031f4ab21af 2023-11-02 21:57:02,783 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110299a44a9b3eee46d5b56609ba1d93061d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110299a44a9b3eee46d5b56609ba1d93061d 2023-11-02 21:57:02,783 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102db18a370d8bd45c2a1934873de26bc15 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231102db18a370d8bd45c2a1934873de26bc15 2023-11-02 21:57:03,190 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/c8f8d05377d54c999c399e899c77f90f 2023-11-02 21:57:03,197 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/b48e4659b11f4264ae324e13d8dc9bd2 2023-11-02 21:57:03,197 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/7b3de60474f941ba99c32f361c38a0f0 2023-11-02 21:57:03,200 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/3a77396452e949bdaa031b39ff65c846 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/3a77396452e949bdaa031b39ff65c846 2023-11-02 21:57:03,205 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/e3c0e2e20b12497081e3718420251a17 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e3c0e2e20b12497081e3718420251a17 2023-11-02 21:57:03,205 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/3032660c3acd4a088d38f7119b15add6 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/3032660c3acd4a088d38f7119b15add6 2023-11-02 21:57:03,206 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/3a77396452e949bdaa031b39ff65c846, entries=4, sequenceid=9, filesize=5.4 K 2023-11-02 21:57:03,208 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/c8f8d05377d54c999c399e899c77f90f as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/c8f8d05377d54c999c399e899c77f90f 2023-11-02 21:57:03,211 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e3c0e2e20b12497081e3718420251a17, entries=4, sequenceid=9, filesize=5.4 K 2023-11-02 21:57:03,211 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/3032660c3acd4a088d38f7119b15add6, entries=4, sequenceid=9, filesize=5.4 K 2023-11-02 21:57:03,211 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/7b3de60474f941ba99c32f361c38a0f0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7b3de60474f941ba99c32f361c38a0f0 2023-11-02 21:57:03,212 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/b48e4659b11f4264ae324e13d8dc9bd2 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/b48e4659b11f4264ae324e13d8dc9bd2 2023-11-02 21:57:03,213 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/c8f8d05377d54c999c399e899c77f90f, entries=2, sequenceid=9, filesize=5.1 K 2023-11-02 21:57:03,214 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e92d97a5fce63a593b6e19d1ce049ed1 in 1681ms, sequenceid=9, compaction requested=false 2023-11-02 21:57:03,214 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:03,214 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:03,214 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:57:03,215 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7b3de60474f941ba99c32f361c38a0f0, entries=2, sequenceid=9, filesize=5.1 K 2023-11-02 21:57:03,216 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/b48e4659b11f4264ae324e13d8dc9bd2, entries=2, sequenceid=9, filesize=5.1 K 2023-11-02 21:57:03,216 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 454cd05942026638919fcedce9e68ca5 in 1683ms, sequenceid=9, compaction requested=false 2023-11-02 21:57:03,216 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8cb793f0a9b02d274d44d3bfb0a21f4c in 1683ms, sequenceid=9, compaction requested=false 2023-11-02 21:57:03,216 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:03,216 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:03,216 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:03,216 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:03,216 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:57:03,216 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:57:03,216 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:57:03,217 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,217 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-02 21:57:03,217 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-02 21:57:03,280 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,280 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:03,281 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:03,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:03,281 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:03,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:03,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:03,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-02 21:57:03,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f1e7798[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:03,288 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-02 21:57:03,288 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:03,372 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:03,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:03,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:03,373 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-02 21:57:03,373 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-02 21:57:03,373 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:03,374 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,374 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:03,406 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,406 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-02 21:57:03,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:03,406 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:03,407 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-02 21:57:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:03,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:03,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:03,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:03,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:03,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-02 21:57:03,418 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-02 21:57:03,418 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:03,418 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:03,418 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-02 21:57:03,418 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:03,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:03,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:03,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:03,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:03,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:03,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:03,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:03,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:03,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:03,428 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:03,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:03,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:03,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:03,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:03,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:03,429 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:03,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:03,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,437 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,437 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:03,437 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:03,437 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,438 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:03,438 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:03,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-02 21:57:03,437 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:03,438 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:03,438 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:03,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-02 21:57:03,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:03,438 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:03,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:03,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:03,438 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:03,439 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:03,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:03,539 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:03,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:03,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:03,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:03,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:03,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:03,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:03,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-02 21:57:03,553 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-02 21:57:03,553 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:03,553 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-02 21:57:03,553 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-02 21:57:03,554 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:03,554 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:03,563 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,564 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:03,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:03,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:03,564 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:03,564 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:03,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:03,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:03,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:03,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:03,565 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-02 21:57:03,565 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-02 21:57:03,565 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-02 21:57:03,565 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-02 21:57:03,565 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:03,566 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-02 21:57:03,566 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:03,566 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. started... 2023-11-02 21:57:03,566 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:03,566 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. started... 2023-11-02 21:57:03,566 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:57:03,566 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:03,566 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:03,566 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. started... 2023-11-02 21:57:03,566 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e92d97a5fce63a593b6e19d1ce049ed1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-02 21:57:03,566 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 454cd05942026638919fcedce9e68ca5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-02 21:57:03,566 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8cb793f0a9b02d274d44d3bfb0a21f4c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-02 21:57:03,984 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311028dab142c14584251a5877015268751d1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311028dab142c14584251a5877015268751d1 2023-11-02 21:57:03,985 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102ac547861f979418a8685b5e98dcc18f5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102ac547861f979418a8685b5e98dcc18f5 2023-11-02 21:57:03,986 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102166a86e12ef8486e8359c4608307a331 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102166a86e12ef8486e8359c4608307a331 2023-11-02 21:57:04,094 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-02 21:57:04,391 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/e835f2cfb63c42209cb7a01958349057 2023-11-02 21:57:04,391 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/18a533b01d9940f0a9fe13e571b385f5 2023-11-02 21:57:04,391 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/2d9852452ca04fe185383d0279718d4b 2023-11-02 21:57:04,407 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102311906feacd04d909df7e3633f8e49c3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102311906feacd04d909df7e3633f8e49c3 2023-11-02 21:57:04,812 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/870e9d20c5d04aceb005625456982fd0 2023-11-02 21:57:04,815 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311020c36c83628dc4032a15d80b5ae491c33 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020c36c83628dc4032a15d80b5ae491c33 2023-11-02 21:57:04,815 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102ac786ca976dd478bbcdca4701c3cc967 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102ac786ca976dd478bbcdca4701c3cc967 2023-11-02 21:57:04,819 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/18a533b01d9940f0a9fe13e571b385f5 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/18a533b01d9940f0a9fe13e571b385f5 2023-11-02 21:57:04,824 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/18a533b01d9940f0a9fe13e571b385f5, entries=4, sequenceid=13, filesize=5.4 K 2023-11-02 21:57:04,824 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/870e9d20c5d04aceb005625456982fd0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/870e9d20c5d04aceb005625456982fd0 2023-11-02 21:57:04,828 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/870e9d20c5d04aceb005625456982fd0, entries=2, sequenceid=13, filesize=5.1 K 2023-11-02 21:57:04,829 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8cb793f0a9b02d274d44d3bfb0a21f4c in 1263ms, sequenceid=13, compaction requested=true 2023-11-02 21:57:04,829 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:04,829 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:04,829 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:57:05,223 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/c682338388994c998ba19a99397aa2a1 2023-11-02 21:57:05,223 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/d8bbf46a711b4b8db58bfad4e20f39d9 2023-11-02 21:57:05,232 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/e835f2cfb63c42209cb7a01958349057 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e835f2cfb63c42209cb7a01958349057 2023-11-02 21:57:05,232 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/2d9852452ca04fe185383d0279718d4b as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2d9852452ca04fe185383d0279718d4b 2023-11-02 21:57:05,237 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e835f2cfb63c42209cb7a01958349057, entries=4, sequenceid=13, filesize=5.4 K 2023-11-02 21:57:05,237 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2d9852452ca04fe185383d0279718d4b, entries=4, sequenceid=13, filesize=5.4 K 2023-11-02 21:57:05,238 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/c682338388994c998ba19a99397aa2a1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c682338388994c998ba19a99397aa2a1 2023-11-02 21:57:05,238 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/d8bbf46a711b4b8db58bfad4e20f39d9 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/d8bbf46a711b4b8db58bfad4e20f39d9 2023-11-02 21:57:05,244 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/d8bbf46a711b4b8db58bfad4e20f39d9, entries=2, sequenceid=13, filesize=5.1 K 2023-11-02 21:57:05,244 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c682338388994c998ba19a99397aa2a1, entries=2, sequenceid=13, filesize=5.1 K 2023-11-02 21:57:05,245 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e92d97a5fce63a593b6e19d1ce049ed1 in 1679ms, sequenceid=13, compaction requested=true 2023-11-02 21:57:05,245 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 454cd05942026638919fcedce9e68ca5 in 1679ms, sequenceid=13, compaction requested=true 2023-11-02 21:57:05,245 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:05,245 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:05,245 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:05,246 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:05,246 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:57:05,246 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:57:05,246 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:57:05,246 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,246 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-02 21:57:05,246 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-02 21:57:05,301 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,301 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:05,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:05,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:05,302 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:05,302 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:05,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:05,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:05,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:05,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:05,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-02 21:57:05,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61858eb4[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:05,308 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-02 21:57:05,308 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:05,322 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:05,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:05,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:05,323 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-02 21:57:05,323 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-02 21:57:05,323 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:05,323 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,323 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:05,332 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-02 21:57:05,332 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:05,332 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-02 21:57:05,332 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:05,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:05,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:05,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-02 21:57:05,343 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-02 21:57:05,343 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:05,343 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:05,343 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-02 21:57:05,343 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:05,353 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:05,353 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:05,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:05,353 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:05,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:05,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:05,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:05,355 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:05,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,360 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:05,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:05,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:05,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-02 21:57:05,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:05,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:05,375 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,375 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:05,375 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:05,375 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:05,374 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:05,375 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:05,375 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:05,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:05,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:05,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:05,475 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:05,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:05,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:05,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:05,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:05,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:05,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:05,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-02 21:57:05,490 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-02 21:57:05,490 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:05,490 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-02 21:57:05,490 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-02 21:57:05,491 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:05,491 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:05,500 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:05,500 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:05,501 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:05,501 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:05,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:05,503 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-02 21:57:05,503 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-02 21:57:05,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-02 21:57:05,503 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-02 21:57:05,503 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:05,503 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-02 21:57:05,504 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:05,504 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. started... 2023-11-02 21:57:05,504 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:05,504 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:57:05,504 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:05,504 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e92d97a5fce63a593b6e19d1ce049ed1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-02 21:57:05,504 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:05,504 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. started... 2023-11-02 21:57:05,504 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. started... 2023-11-02 21:57:05,504 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 454cd05942026638919fcedce9e68ca5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-02 21:57:05,504 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8cb793f0a9b02d274d44d3bfb0a21f4c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-02 21:57:05,932 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102097e0a8c68f042799a8159cebe992a3c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102097e0a8c68f042799a8159cebe992a3c 2023-11-02 21:57:05,932 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311027003d2a3c4ff45178d583fba2bc57146 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311027003d2a3c4ff45178d583fba2bc57146 2023-11-02 21:57:05,932 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311026263a75a724a4c48b6f8ca0361c09826 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311026263a75a724a4c48b6f8ca0361c09826 2023-11-02 21:57:06,345 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/2bd746d37a654a86a4241011c62693a0 2023-11-02 21:57:06,345 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/0d56ed6ce0564ee1a7e3b36eeab14fe3 2023-11-02 21:57:06,345 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/d456e6ec03af47d78913c6d95f23a2a3 2023-11-02 21:57:06,359 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110273ad67dc4c7a482295f4614761ad4fc1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110273ad67dc4c7a482295f4614761ad4fc1 2023-11-02 21:57:06,799 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/505b19834856471cb32c7a9acf96927b 2023-11-02 21:57:06,803 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102b0e45cf8564f483d94299e55522bc2f5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102b0e45cf8564f483d94299e55522bc2f5 2023-11-02 21:57:06,803 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102ed2cdd2fd0d343a9aea1369c61a79f68 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231102ed2cdd2fd0d343a9aea1369c61a79f68 2023-11-02 21:57:06,810 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/2bd746d37a654a86a4241011c62693a0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2bd746d37a654a86a4241011c62693a0 2023-11-02 21:57:06,813 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/dc91a1a8c98e4b0881ccb1cf93d58c25 2023-11-02 21:57:06,814 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2bd746d37a654a86a4241011c62693a0, entries=4, sequenceid=17, filesize=5.4 K 2023-11-02 21:57:06,815 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/505b19834856471cb32c7a9acf96927b as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/505b19834856471cb32c7a9acf96927b 2023-11-02 21:57:06,817 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/d456e6ec03af47d78913c6d95f23a2a3 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/d456e6ec03af47d78913c6d95f23a2a3 2023-11-02 21:57:06,819 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/505b19834856471cb32c7a9acf96927b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-02 21:57:06,820 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e92d97a5fce63a593b6e19d1ce049ed1 in 1316ms, sequenceid=17, compaction requested=true 2023-11-02 21:57:06,820 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:06,820 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:06,820 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:57:06,821 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/d456e6ec03af47d78913c6d95f23a2a3, entries=4, sequenceid=17, filesize=5.4 K 2023-11-02 21:57:06,821 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/dc91a1a8c98e4b0881ccb1cf93d58c25 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/dc91a1a8c98e4b0881ccb1cf93d58c25 2023-11-02 21:57:06,826 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/dc91a1a8c98e4b0881ccb1cf93d58c25, entries=2, sequenceid=17, filesize=5.1 K 2023-11-02 21:57:06,827 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 454cd05942026638919fcedce9e68ca5 in 1323ms, sequenceid=17, compaction requested=true 2023-11-02 21:57:06,827 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:06,827 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:06,827 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:57:07,213 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/7e43d0ae81af471cb16b3e84939b032c 2023-11-02 21:57:07,223 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/0d56ed6ce0564ee1a7e3b36eeab14fe3 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/0d56ed6ce0564ee1a7e3b36eeab14fe3 2023-11-02 21:57:07,229 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/0d56ed6ce0564ee1a7e3b36eeab14fe3, entries=4, sequenceid=17, filesize=5.4 K 2023-11-02 21:57:07,230 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/7e43d0ae81af471cb16b3e84939b032c as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/7e43d0ae81af471cb16b3e84939b032c 2023-11-02 21:57:07,235 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/7e43d0ae81af471cb16b3e84939b032c, entries=2, sequenceid=17, filesize=5.1 K 2023-11-02 21:57:07,236 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8cb793f0a9b02d274d44d3bfb0a21f4c in 1732ms, sequenceid=17, compaction requested=true 2023-11-02 21:57:07,237 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:07,237 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:07,237 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:57:07,237 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:57:07,237 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,237 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-02 21:57:07,237 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-02 21:57:07,290 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:07,290 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:07,290 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:07,290 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:07,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:07,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:07,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:07,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-02 21:57:07,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a51781[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:07,292 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-02 21:57:07,292 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:07,300 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:07,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:07,300 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-02 21:57:07,300 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-02 21:57:07,300 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:07,301 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,301 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:07,311 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-02 21:57:07,311 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:07,311 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-02 21:57:07,311 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:07,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:07,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:07,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-02 21:57:07,316 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-02 21:57:07,316 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:07,316 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:07,316 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-02 21:57:07,316 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:07,330 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:07,330 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:07,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:07,330 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:07,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:07,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:07,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:07,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:07,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:07,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:07,331 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:07,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:07,333 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,373 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,373 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:07,373 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:07,373 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:07,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-02 21:57:07,373 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:07,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:07,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:07,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:07,373 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:07,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:07,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:07,374 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:07,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-02 21:57:07,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:07,374 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:07,375 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:07,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:07,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:07,411 DEBUG [regionserver/jenkins-hbase12:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-02 21:57:07,475 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:07,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:07,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1583): Client=jenkins//136.243.104.168 snapshot request for:{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-02 21:57:07,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698962227489 (current time:1698962227489). 2023-11-02 21:57:07,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-02 21:57:07,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] zookeeper.ReadOnlyZKClient(139): Connect 0x30c7d462 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:57:07,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d6d4d2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:57:07,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:57:07,522 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:57:07,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30c7d462 to 127.0.0.1:49550 2023-11-02 21:57:07,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:57:07,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-02 21:57:07,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-02 21:57:07,534 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot, current working dir path: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp/snaptb-1698962227477 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-02 21:57:07,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-02 21:57:07,541 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-02 21:57:07,542 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698962827542 2023-11-02 21:57:07,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-02 21:57:07,542 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1698962227477 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-02 21:57:07,543 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-02 21:57:07,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-02 21:57:07,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-11-02 21:57:07,544 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-02 21:57:07,545 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1698962827545 2023-11-02 21:57:07,548 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:07,548 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-02 21:57:07,648 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-02 21:57:07,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-02 21:57:07,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-02 21:57:07,654 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-02 21:57:07,854 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-02 21:57:07,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-02 21:57:07,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-02 21:57:07,856 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-02 21:57:07,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1698962227477 2023-11-02 21:57:07,957 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1698962227477' 2023-11-02 21:57:07,957 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-02 21:57:07,957 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1698962227477' starting 'acquire' 2023-11-02 21:57:07,957 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1698962227477', kicking off acquire phase on members. 2023-11-02 21:57:07,959 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698962227477 2023-11-02 21:57:07,959 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1698962227477 2023-11-02 21:57:08,079 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-02 21:57:08,079 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-02 21:57:08,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-02 21:57:08,080 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,080 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1698962227477 2023-11-02 21:57:08,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698962227477 2023-11-02 21:57:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-02 21:57:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1698962227477 2023-11-02 21:57:08,082 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1698962227477 from table testCompactionWithHFileLink type FLUSH 2023-11-02 21:57:08,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1698962227477 2023-11-02 21:57:08,087 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1698962227477' with timeout 300000ms 2023-11-02 21:57:08,087 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-02 21:57:08,087 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1698962227477' starting 'acquire' stage 2023-11-02 21:57:08,087 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1698962227477' locally acquired 2023-11-02 21:57:08,087 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (snaptb-1698962227477) in zk 2023-11-02 21:57:08,109 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1698962227477 2023-11-02 21:57:08,109 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-02 21:57:08,110 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698962227477 2023-11-02 21:57:08,110 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1698962227477' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:08,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:08,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:08,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698962227477 2023-11-02 21:57:08,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:08,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'snaptb-1698962227477' on coordinator 2023-11-02 21:57:08,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@778bc37[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:08,115 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1698962227477' starting 'in-barrier' execution. 2023-11-02 21:57:08,115 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1698962227477 2023-11-02 21:57:08,121 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698962227477 2023-11-02 21:57:08,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1698962227477 2023-11-02 21:57:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1698962227477 2023-11-02 21:57:08,121 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1698962227477' received 'reached' from coordinator. 2023-11-02 21:57:08,121 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,121 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:08,122 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:08,122 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:08,122 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-02 21:57:08,122 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:08,122 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-02 21:57:08,123 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. started... 2023-11-02 21:57:08,123 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. started... 2023-11-02 21:57:08,123 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. started... 2023-11-02 21:57:08,123 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:08,123 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:08,123 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:08,123 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.' region-info for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,123 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.' region-info for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,123 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.' region-info for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,127 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-02 21:57:08,127 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-02 21:57:08,127 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-02 21:57:08,130 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/787fcae96a10496a81fcf126814cf8af, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/3032660c3acd4a088d38f7119b15add6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/18a533b01d9940f0a9fe13e571b385f5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/0d56ed6ce0564ee1a7e3b36eeab14fe3] hfiles 2023-11-02 21:57:08,130 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/2e237e52069c459b870bb650ad8b650c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e3c0e2e20b12497081e3718420251a17, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e835f2cfb63c42209cb7a01958349057, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/d456e6ec03af47d78913c6d95f23a2a3] hfiles 2023-11-02 21:57:08,130 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/2e237e52069c459b870bb650ad8b650c for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,130 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/5c7167f400834f81aeb00a99432501a4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/3a77396452e949bdaa031b39ff65c846, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2d9852452ca04fe185383d0279718d4b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2bd746d37a654a86a4241011c62693a0] hfiles 2023-11-02 21:57:08,130 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/787fcae96a10496a81fcf126814cf8af for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,131 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/5c7167f400834f81aeb00a99432501a4 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e3c0e2e20b12497081e3718420251a17 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/3032660c3acd4a088d38f7119b15add6 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/3a77396452e949bdaa031b39ff65c846 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/18a533b01d9940f0a9fe13e571b385f5 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e835f2cfb63c42209cb7a01958349057 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/d456e6ec03af47d78913c6d95f23a2a3 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/0d56ed6ce0564ee1a7e3b36eeab14fe3 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2d9852452ca04fe185383d0279718d4b for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2bd746d37a654a86a4241011c62693a0 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c0441b139ac644c78bfc0e67b12841ca, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7b3de60474f941ba99c32f361c38a0f0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c682338388994c998ba19a99397aa2a1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/dc91a1a8c98e4b0881ccb1cf93d58c25] hfiles 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c0441b139ac644c78bfc0e67b12841ca for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/9323316882f34a2c94235b58ef89c8e0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/b48e4659b11f4264ae324e13d8dc9bd2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/870e9d20c5d04aceb005625456982fd0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/7e43d0ae81af471cb16b3e84939b032c] hfiles 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7b3de60474f941ba99c32f361c38a0f0 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/4d756e51562648fdb2cf3e7190f433e2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/c8f8d05377d54c999c399e899c77f90f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/d8bbf46a711b4b8db58bfad4e20f39d9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/505b19834856471cb32c7a9acf96927b] hfiles 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c682338388994c998ba19a99397aa2a1 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/9323316882f34a2c94235b58ef89c8e0 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/dc91a1a8c98e4b0881ccb1cf93d58c25 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/4d756e51562648fdb2cf3e7190f433e2 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/b48e4659b11f4264ae324e13d8dc9bd2 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/c8f8d05377d54c999c399e899c77f90f for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/870e9d20c5d04aceb005625456982fd0 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,135 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/d8bbf46a711b4b8db58bfad4e20f39d9 for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,136 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/7e43d0ae81af471cb16b3e84939b032c for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,136 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/505b19834856471cb32c7a9acf96927b for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,157 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-02 21:57:08,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-02 21:57:08,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-02 21:57:08,158 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-02 21:57:08,548 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. completed. 2023-11-02 21:57:08,548 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. completed. 2023-11-02 21:57:08,549 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:08,549 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. completed. 2023-11-02 21:57:08,549 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:08,549 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:08,550 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-02 21:57:08,550 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-02 21:57:08,550 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-02 21:57:08,550 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-02 21:57:08,550 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,551 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1698962227477' locally completed 2023-11-02 21:57:08,551 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1698962227477' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:08,606 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,606 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1698962227477' has notified controller of completion 2023-11-02 21:57:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-02 21:57:08,606 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:08,607 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1698962227477' completed. 2023-11-02 21:57:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698962227477 2023-11-02 21:57:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698962227477 2023-11-02 21:57:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1698962227477' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:08,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'snaptb-1698962227477', counting down latch. Waiting for 0 more 2023-11-02 21:57:08,613 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1698962227477' execution completed 2023-11-02 21:57:08,613 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:08,613 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:08,613 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1698962227477 2023-11-02 21:57:08,613 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1698962227477including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-02 21:57:08,626 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698962227477 2023-11-02 21:57:08,626 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698962227477 2023-11-02 21:57:08,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1698962227477 2023-11-02 21:57:08,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1698962227477 2023-11-02 21:57:08,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:08,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-02 21:57:08,626 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-02 21:57:08,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698962227477 2023-11-02 21:57:08,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:08,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-02 21:57:08,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-02 21:57:08,628 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698962227477 2023-11-02 21:57:08,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698962227477 2023-11-02 21:57:08,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:08,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698962227477 2023-11-02 21:57:08,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,630 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:08,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698962227477 2023-11-02 21:57:08,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,637 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,637 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698962227477 2023-11-02 21:57:08,637 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698962227477 2023-11-02 21:57:08,637 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698962227477/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:08,637 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698962227477 2023-11-02 21:57:08,637 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-02 21:57:08,637 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:08,637 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698962227477 2023-11-02 21:57:08,638 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698962227477 2023-11-02 21:57:08,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-02 21:57:08,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-02 21:57:08,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1698962227477 2023-11-02 21:57:08,637 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-02 21:57:08,638 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-02 21:57:08,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1698962227477 2023-11-02 21:57:08,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-02 21:57:08,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-02 21:57:08,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102097e0a8c68f042799a8159cebe992a3c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102166a86e12ef8486e8359c4608307a331, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102221d5173092c40dbb3e3968cd4b64c3b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311026cec23cd08644e39a32214fd597f0ad4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311025424dd532c8c4e389d9d631213d584fd, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311027003d2a3c4ff45178d583fba2bc57146, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102ac547861f979418a8685b5e98dcc18f5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102b634842f9dea468cbd0ec0ec91e6acdc, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311026263a75a724a4c48b6f8ca0361c09826, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311028dab142c14584251a5877015268751d1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102a0534c275a1c47c0bc70f6b61a693598, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102acd189c881b648719a86dcf5141355e3] mob files 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102097e0a8c68f042799a8159cebe992a3c 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102166a86e12ef8486e8359c4608307a331 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102221d5173092c40dbb3e3968cd4b64c3b 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311026cec23cd08644e39a32214fd597f0ad4 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311025424dd532c8c4e389d9d631213d584fd 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311027003d2a3c4ff45178d583fba2bc57146 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102ac547861f979418a8685b5e98dcc18f5 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102b634842f9dea468cbd0ec0ec91e6acdc 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311026263a75a724a4c48b6f8ca0361c09826 2023-11-02 21:57:08,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311028dab142c14584251a5877015268751d1 2023-11-02 21:57:08,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102a0534c275a1c47c0bc70f6b61a693598 2023-11-02 21:57:08,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102acd189c881b648719a86dcf5141355e3 2023-11-02 21:57:08,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311022820230baffa4682a6c94031f4ab21af, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110273ad67dc4c7a482295f4614761ad4fc1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102862cb5e4d7254e3cb1cd5b14759bb7e7, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102ac786ca976dd478bbcdca4701c3cc967, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020578b0d06f4047ceb7f6a3f8b21f5407, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020c36c83628dc4032a15d80b5ae491c33, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231102db18a370d8bd45c2a1934873de26bc15, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231102ed2cdd2fd0d343a9aea1369c61a79f68, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102311906feacd04d909df7e3633f8e49c3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311027684f3496d354d02ac06d38a0398456d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110299a44a9b3eee46d5b56609ba1d93061d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102b0e45cf8564f483d94299e55522bc2f5] mob files 2023-11-02 21:57:08,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311022820230baffa4682a6c94031f4ab21af 2023-11-02 21:57:08,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110273ad67dc4c7a482295f4614761ad4fc1 2023-11-02 21:57:08,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102862cb5e4d7254e3cb1cd5b14759bb7e7 2023-11-02 21:57:08,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102ac786ca976dd478bbcdca4701c3cc967 2023-11-02 21:57:08,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020578b0d06f4047ceb7f6a3f8b21f5407 2023-11-02 21:57:08,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020c36c83628dc4032a15d80b5ae491c33 2023-11-02 21:57:08,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231102db18a370d8bd45c2a1934873de26bc15 2023-11-02 21:57:08,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231102ed2cdd2fd0d343a9aea1369c61a79f68 2023-11-02 21:57:08,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102311906feacd04d909df7e3633f8e49c3 2023-11-02 21:57:08,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311027684f3496d354d02ac06d38a0398456d 2023-11-02 21:57:08,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110299a44a9b3eee46d5b56609ba1d93061d 2023-11-02 21:57:08,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102b0e45cf8564f483d94299e55522bc2f5 2023-11-02 21:57:08,658 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-02 21:57:08,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-02 21:57:08,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-02 21:57:08,660 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-02 21:57:09,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1698962227477 2023-11-02 21:57:09,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp/snaptb-1698962227477 2023-11-02 21:57:09,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp/snaptb-1698962227477 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/snaptb-1698962227477 2023-11-02 21:57:09,501 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1698962227477 of table testCompactionWithHFileLink completed 2023-11-02 21:57:09,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp/snaptb-1698962227477 2023-11-02 21:57:09,501 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp/snaptb-1698962227477 2023-11-02 21:57:09,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1698962227477 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698962227542Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1698962229050 (+1508 ms)Consolidate snapshot: snaptb-1698962227477 at 1698962229050Loading Region manifests for snaptb-1698962227477 at 1698962229051 (+1 ms)Writing data manifest for snaptb-1698962227477 at 1698962229063 (+12 ms)Verifying snapshot: snaptb-1698962227477 at 1698962229475 (+412 ms)Snapshot snaptb-1698962227477 of table testCompactionWithHFileLink completed at 1698962229500 (+25 ms) 2023-11-02 21:57:09,502 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-02 21:57:09,503 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.9590 sec 2023-11-02 21:57:09,597 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:57:09,660 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-02 21:57:09,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-02 21:57:09,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-02 21:57:09,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:09,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:09,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-02 21:57:09,696 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-02 21:57:09,696 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:09,696 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-02 21:57:09,696 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-02 21:57:09,696 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:09,696 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:09,753 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:09,753 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:09,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:09,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:09,753 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:09,753 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:09,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:09,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:09,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:09,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:09,755 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-02 21:57:09,755 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-02 21:57:09,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-02 21:57:09,755 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-02 21:57:09,756 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:09,756 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-02 21:57:09,756 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:09,756 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. started... 2023-11-02 21:57:09,756 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:09,756 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e92d97a5fce63a593b6e19d1ce049ed1 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-02 21:57:09,756 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:09,756 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:57:09,757 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:09,756 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. started... 2023-11-02 21:57:09,756 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. started... 2023-11-02 21:57:09,757 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 454cd05942026638919fcedce9e68ca5 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-02 21:57:09,757 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8cb793f0a9b02d274d44d3bfb0a21f4c 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-02 21:57:10,173 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/6ba68588c49c4419952b46609e4a7510 2023-11-02 21:57:10,177 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ba68588c49c4419952b46609e4a7510 2023-11-02 21:57:10,575 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/afcbbd9fe1a14e14981ac2e355ac829a 2023-11-02 21:57:10,576 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/dc4fc1881a184f91964d70a9413c8195 2023-11-02 21:57:10,583 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for afcbbd9fe1a14e14981ac2e355ac829a 2023-11-02 21:57:10,584 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc4fc1881a184f91964d70a9413c8195 2023-11-02 21:57:10,991 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/7aa3d0f314594bb3a4f1129b39456c3d 2023-11-02 21:57:10,996 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/88cb1adef60f46969eb62855cc9abc20 2023-11-02 21:57:10,997 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/5eb9345774fe49cb9df0cab4e9e9a856 2023-11-02 21:57:10,998 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7aa3d0f314594bb3a4f1129b39456c3d 2023-11-02 21:57:10,999 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/6ba68588c49c4419952b46609e4a7510 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/6ba68588c49c4419952b46609e4a7510 2023-11-02 21:57:11,002 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88cb1adef60f46969eb62855cc9abc20 2023-11-02 21:57:11,003 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5eb9345774fe49cb9df0cab4e9e9a856 2023-11-02 21:57:11,003 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/afcbbd9fe1a14e14981ac2e355ac829a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/afcbbd9fe1a14e14981ac2e355ac829a 2023-11-02 21:57:11,004 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/dc4fc1881a184f91964d70a9413c8195 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/dc4fc1881a184f91964d70a9413c8195 2023-11-02 21:57:11,005 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ba68588c49c4419952b46609e4a7510 2023-11-02 21:57:11,006 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/6ba68588c49c4419952b46609e4a7510, entries=3, sequenceid=24, filesize=5.0 K 2023-11-02 21:57:11,006 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/7aa3d0f314594bb3a4f1129b39456c3d as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7aa3d0f314594bb3a4f1129b39456c3d 2023-11-02 21:57:11,008 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for afcbbd9fe1a14e14981ac2e355ac829a 2023-11-02 21:57:11,008 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/afcbbd9fe1a14e14981ac2e355ac829a, entries=3, sequenceid=24, filesize=5.0 K 2023-11-02 21:57:11,009 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc4fc1881a184f91964d70a9413c8195 2023-11-02 21:57:11,009 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/dc4fc1881a184f91964d70a9413c8195, entries=3, sequenceid=24, filesize=5.0 K 2023-11-02 21:57:11,009 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/88cb1adef60f46969eb62855cc9abc20 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/88cb1adef60f46969eb62855cc9abc20 2023-11-02 21:57:11,010 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/5eb9345774fe49cb9df0cab4e9e9a856 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/5eb9345774fe49cb9df0cab4e9e9a856 2023-11-02 21:57:11,011 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7aa3d0f314594bb3a4f1129b39456c3d 2023-11-02 21:57:11,011 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7aa3d0f314594bb3a4f1129b39456c3d, entries=1, sequenceid=24, filesize=5.0 K 2023-11-02 21:57:11,012 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 454cd05942026638919fcedce9e68ca5 in 1255ms, sequenceid=24, compaction requested=true 2023-11-02 21:57:11,012 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:11,012 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:11,012 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:57:11,014 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88cb1adef60f46969eb62855cc9abc20 2023-11-02 21:57:11,014 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5eb9345774fe49cb9df0cab4e9e9a856 2023-11-02 21:57:11,014 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/88cb1adef60f46969eb62855cc9abc20, entries=1, sequenceid=24, filesize=5.0 K 2023-11-02 21:57:11,014 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/5eb9345774fe49cb9df0cab4e9e9a856, entries=1, sequenceid=24, filesize=5.0 K 2023-11-02 21:57:11,014 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8cb793f0a9b02d274d44d3bfb0a21f4c in 1257ms, sequenceid=24, compaction requested=true 2023-11-02 21:57:11,014 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e92d97a5fce63a593b6e19d1ce049ed1 in 1258ms, sequenceid=24, compaction requested=true 2023-11-02 21:57:11,014 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:11,014 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:11,014 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:11,015 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:11,015 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:57:11,015 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:57:11,015 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:57:11,015 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,015 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-02 21:57:11,015 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-02 21:57:11,068 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,068 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:11,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:11,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:11,069 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:11,069 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:11,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:11,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:11,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:11,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:11,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-02 21:57:11,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b36a9f7[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:11,070 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-02 21:57:11,070 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:11,079 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:11,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:11,079 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-02 21:57:11,079 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-02 21:57:11,079 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:11,079 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,079 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:11,089 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,089 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-02 21:57:11,089 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:11,089 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-02 21:57:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:11,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-02 21:57:11,091 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-02 21:57:11,091 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:11,091 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:11,092 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-02 21:57:11,092 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:11,100 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:11,100 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:11,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:11,100 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:11,100 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:11,101 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-02 21:57:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,110 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,110 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:11,110 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:11,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:11,110 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:11,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-02 21:57:11,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:11,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:11,110 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-02 21:57:11,110 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:11,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:11,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:11,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-02 21:57:11,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-02 21:57:11,111 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:11,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:11,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-02 21:57:11,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:11,111 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:11,211 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:11,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:11,213 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:11,213 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): e92d97a5fce63a593b6e19d1ce049ed1/family1 is initiating major compaction (all files) 2023-11-02 21:57:11,213 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:11,213 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:11,213 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of e92d97a5fce63a593b6e19d1ce049ed1/family1 in testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:11,213 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/5c7167f400834f81aeb00a99432501a4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/3a77396452e949bdaa031b39ff65c846, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2d9852452ca04fe185383d0279718d4b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2bd746d37a654a86a4241011c62693a0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/afcbbd9fe1a14e14981ac2e355ac829a] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp, totalSize=26.7 K 2023-11-02 21:57:11,214 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 5c7167f400834f81aeb00a99432501a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219482 2023-11-02 21:57:11,214 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 3a77396452e949bdaa031b39ff65c846, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221482 2023-11-02 21:57:11,215 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 2d9852452ca04fe185383d0279718d4b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223545 2023-11-02 21:57:11,215 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 2bd746d37a654a86a4241011c62693a0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225480 2023-11-02 21:57:11,215 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting afcbbd9fe1a14e14981ac2e355ac829a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-02 21:57:11,231 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): e92d97a5fce63a593b6e19d1ce049ed1#family1#compaction#108 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:11,649 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110250f20b3c811246baa9f1e5c8714e173a_del 2023-11-02 21:57:11,649 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110250f20b3c811246baa9f1e5c8714e173a_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110250f20b3c811246baa9f1e5c8714e173a_del 2023-11-02 21:57:12,494 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91fae927f6254deaa1ea7562d19cd4b2 2023-11-02 21:57:12,495 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/91fae927f6254deaa1ea7562d19cd4b2 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/91fae927f6254deaa1ea7562d19cd4b2 2023-11-02 21:57:12,500 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91fae927f6254deaa1ea7562d19cd4b2 2023-11-02 21:57:12,501 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e92d97a5fce63a593b6e19d1ce049ed1/family1 of e92d97a5fce63a593b6e19d1ce049ed1 into 91fae927f6254deaa1ea7562d19cd4b2(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:12,501 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:12,501 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:12,501 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): e92d97a5fce63a593b6e19d1ce049ed1/family2 is initiating major compaction (all files) 2023-11-02 21:57:12,502 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:12,502 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:12,502 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of e92d97a5fce63a593b6e19d1ce049ed1/family2 in testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:12,502 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/4d756e51562648fdb2cf3e7190f433e2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/c8f8d05377d54c999c399e899c77f90f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/d8bbf46a711b4b8db58bfad4e20f39d9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/505b19834856471cb32c7a9acf96927b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/88cb1adef60f46969eb62855cc9abc20] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp, totalSize=25.4 K 2023-11-02 21:57:12,502 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 4d756e51562648fdb2cf3e7190f433e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219482 2023-11-02 21:57:12,503 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting c8f8d05377d54c999c399e899c77f90f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221482 2023-11-02 21:57:12,503 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting d8bbf46a711b4b8db58bfad4e20f39d9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223545 2023-11-02 21:57:12,504 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 505b19834856471cb32c7a9acf96927b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225480 2023-11-02 21:57:12,504 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 88cb1adef60f46969eb62855cc9abc20, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-02 21:57:12,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/5c7167f400834f81aeb00a99432501a4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/3a77396452e949bdaa031b39ff65c846, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2d9852452ca04fe185383d0279718d4b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2bd746d37a654a86a4241011c62693a0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/afcbbd9fe1a14e14981ac2e355ac829a] to archive 2023-11-02 21:57:12,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:12,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/5c7167f400834f81aeb00a99432501a4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/5c7167f400834f81aeb00a99432501a4 2023-11-02 21:57:12,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/3a77396452e949bdaa031b39ff65c846 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/3a77396452e949bdaa031b39ff65c846 2023-11-02 21:57:12,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2d9852452ca04fe185383d0279718d4b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2d9852452ca04fe185383d0279718d4b 2023-11-02 21:57:12,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2bd746d37a654a86a4241011c62693a0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/2bd746d37a654a86a4241011c62693a0 2023-11-02 21:57:12,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/afcbbd9fe1a14e14981ac2e355ac829a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/afcbbd9fe1a14e14981ac2e355ac829a 2023-11-02 21:57:12,522 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): e92d97a5fce63a593b6e19d1ce049ed1#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:12,934 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231102ec17fee1f0c346699a0e253e471faa84_del 2023-11-02 21:57:12,935 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102ec17fee1f0c346699a0e253e471faa84_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102ec17fee1f0c346699a0e253e471faa84_del 2023-11-02 21:57:13,760 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b211b69bad344829b57c20164c4b829 2023-11-02 21:57:13,762 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/1b211b69bad344829b57c20164c4b829 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/1b211b69bad344829b57c20164c4b829 2023-11-02 21:57:13,766 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b211b69bad344829b57c20164c4b829 2023-11-02 21:57:13,767 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e92d97a5fce63a593b6e19d1ce049ed1/family2 of e92d97a5fce63a593b6e19d1ce049ed1 into 1b211b69bad344829b57c20164c4b829(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:13,767 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:13,767 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:13,767 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 is initiating major compaction (all files) 2023-11-02 21:57:13,767 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:13,767 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:13,768 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 in testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:13,768 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/787fcae96a10496a81fcf126814cf8af, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/3032660c3acd4a088d38f7119b15add6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/18a533b01d9940f0a9fe13e571b385f5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/0d56ed6ce0564ee1a7e3b36eeab14fe3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/dc4fc1881a184f91964d70a9413c8195] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp, totalSize=26.7 K 2023-11-02 21:57:13,768 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 787fcae96a10496a81fcf126814cf8af, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219481 2023-11-02 21:57:13,769 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 3032660c3acd4a088d38f7119b15add6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221482 2023-11-02 21:57:13,769 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 18a533b01d9940f0a9fe13e571b385f5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223544 2023-11-02 21:57:13,769 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 0d56ed6ce0564ee1a7e3b36eeab14fe3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225480 2023-11-02 21:57:13,770 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting dc4fc1881a184f91964d70a9413c8195, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-02 21:57:13,783 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 8cb793f0a9b02d274d44d3bfb0a21f4c#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:13,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/4d756e51562648fdb2cf3e7190f433e2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/c8f8d05377d54c999c399e899c77f90f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/d8bbf46a711b4b8db58bfad4e20f39d9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/505b19834856471cb32c7a9acf96927b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/88cb1adef60f46969eb62855cc9abc20] to archive 2023-11-02 21:57:13,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:13,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/4d756e51562648fdb2cf3e7190f433e2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/4d756e51562648fdb2cf3e7190f433e2 2023-11-02 21:57:13,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/c8f8d05377d54c999c399e899c77f90f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/c8f8d05377d54c999c399e899c77f90f 2023-11-02 21:57:13,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/d8bbf46a711b4b8db58bfad4e20f39d9 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/d8bbf46a711b4b8db58bfad4e20f39d9 2023-11-02 21:57:13,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/505b19834856471cb32c7a9acf96927b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/505b19834856471cb32c7a9acf96927b 2023-11-02 21:57:13,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/88cb1adef60f46969eb62855cc9abc20 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/88cb1adef60f46969eb62855cc9abc20 2023-11-02 21:57:14,201 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311025c53f5790f924a138a6534a882797132_del 2023-11-02 21:57:14,201 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311025c53f5790f924a138a6534a882797132_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311025c53f5790f924a138a6534a882797132_del 2023-11-02 21:57:15,029 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37ee3319937a441f9031fd95a0ba6ffa 2023-11-02 21:57:15,031 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/37ee3319937a441f9031fd95a0ba6ffa as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/37ee3319937a441f9031fd95a0ba6ffa 2023-11-02 21:57:15,036 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37ee3319937a441f9031fd95a0ba6ffa 2023-11-02 21:57:15,037 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 of 8cb793f0a9b02d274d44d3bfb0a21f4c into 37ee3319937a441f9031fd95a0ba6ffa(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:15,037 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:15,037 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:15,037 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 8cb793f0a9b02d274d44d3bfb0a21f4c/family2 is initiating major compaction (all files) 2023-11-02 21:57:15,038 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:15,038 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:15,038 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 8cb793f0a9b02d274d44d3bfb0a21f4c/family2 in testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:15,038 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/9323316882f34a2c94235b58ef89c8e0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/b48e4659b11f4264ae324e13d8dc9bd2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/870e9d20c5d04aceb005625456982fd0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/7e43d0ae81af471cb16b3e84939b032c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/5eb9345774fe49cb9df0cab4e9e9a856] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp, totalSize=25.4 K 2023-11-02 21:57:15,038 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 9323316882f34a2c94235b58ef89c8e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219481 2023-11-02 21:57:15,039 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting b48e4659b11f4264ae324e13d8dc9bd2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221482 2023-11-02 21:57:15,039 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 870e9d20c5d04aceb005625456982fd0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223544 2023-11-02 21:57:15,040 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 7e43d0ae81af471cb16b3e84939b032c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225480 2023-11-02 21:57:15,040 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 5eb9345774fe49cb9df0cab4e9e9a856, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-02 21:57:15,057 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 8cb793f0a9b02d274d44d3bfb0a21f4c#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:15,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/787fcae96a10496a81fcf126814cf8af, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/3032660c3acd4a088d38f7119b15add6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/18a533b01d9940f0a9fe13e571b385f5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/0d56ed6ce0564ee1a7e3b36eeab14fe3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/dc4fc1881a184f91964d70a9413c8195] to archive 2023-11-02 21:57:15,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:15,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/787fcae96a10496a81fcf126814cf8af to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/787fcae96a10496a81fcf126814cf8af 2023-11-02 21:57:15,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/3032660c3acd4a088d38f7119b15add6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/3032660c3acd4a088d38f7119b15add6 2023-11-02 21:57:15,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/18a533b01d9940f0a9fe13e571b385f5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/18a533b01d9940f0a9fe13e571b385f5 2023-11-02 21:57:15,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/0d56ed6ce0564ee1a7e3b36eeab14fe3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/0d56ed6ce0564ee1a7e3b36eeab14fe3 2023-11-02 21:57:15,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/dc4fc1881a184f91964d70a9413c8195 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/dc4fc1881a184f91964d70a9413c8195 2023-11-02 21:57:15,474 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231102b7807901397c4d399e99d4f365049500_del 2023-11-02 21:57:15,474 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102b7807901397c4d399e99d4f365049500_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102b7807901397c4d399e99d4f365049500_del 2023-11-02 21:57:16,303 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b16bad097eb4a2ead1f00192805155f 2023-11-02 21:57:16,304 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/1b16bad097eb4a2ead1f00192805155f as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/1b16bad097eb4a2ead1f00192805155f 2023-11-02 21:57:16,310 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b16bad097eb4a2ead1f00192805155f 2023-11-02 21:57:16,311 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8cb793f0a9b02d274d44d3bfb0a21f4c/family2 of 8cb793f0a9b02d274d44d3bfb0a21f4c into 1b16bad097eb4a2ead1f00192805155f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:16,311 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:16,311 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:16,312 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 454cd05942026638919fcedce9e68ca5/family1 is initiating major compaction (all files) 2023-11-02 21:57:16,312 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:16,312 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:16,312 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 454cd05942026638919fcedce9e68ca5/family1 in testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:16,313 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/2e237e52069c459b870bb650ad8b650c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e3c0e2e20b12497081e3718420251a17, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e835f2cfb63c42209cb7a01958349057, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/d456e6ec03af47d78913c6d95f23a2a3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/6ba68588c49c4419952b46609e4a7510] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp, totalSize=26.7 K 2023-11-02 21:57:16,314 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 2e237e52069c459b870bb650ad8b650c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219482 2023-11-02 21:57:16,314 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting e3c0e2e20b12497081e3718420251a17, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221483 2023-11-02 21:57:16,315 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting e835f2cfb63c42209cb7a01958349057, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223545 2023-11-02 21:57:16,315 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting d456e6ec03af47d78913c6d95f23a2a3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225481 2023-11-02 21:57:16,316 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 6ba68588c49c4419952b46609e4a7510, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-02 21:57:16,326 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 454cd05942026638919fcedce9e68ca5#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:16,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/9323316882f34a2c94235b58ef89c8e0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/b48e4659b11f4264ae324e13d8dc9bd2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/870e9d20c5d04aceb005625456982fd0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/7e43d0ae81af471cb16b3e84939b032c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/5eb9345774fe49cb9df0cab4e9e9a856] to archive 2023-11-02 21:57:16,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:16,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/9323316882f34a2c94235b58ef89c8e0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/9323316882f34a2c94235b58ef89c8e0 2023-11-02 21:57:16,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/b48e4659b11f4264ae324e13d8dc9bd2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/b48e4659b11f4264ae324e13d8dc9bd2 2023-11-02 21:57:16,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/870e9d20c5d04aceb005625456982fd0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/870e9d20c5d04aceb005625456982fd0 2023-11-02 21:57:16,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/7e43d0ae81af471cb16b3e84939b032c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/7e43d0ae81af471cb16b3e84939b032c 2023-11-02 21:57:16,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/5eb9345774fe49cb9df0cab4e9e9a856 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/5eb9345774fe49cb9df0cab4e9e9a856 2023-11-02 21:57:16,735 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231102dc74f787146f4078b4bbe55ce198a577_del 2023-11-02 21:57:16,735 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102dc74f787146f4078b4bbe55ce198a577_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102dc74f787146f4078b4bbe55ce198a577_del 2023-11-02 21:57:17,557 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8a0966fbf474f0fa63a0f5c48bda549 2023-11-02 21:57:17,558 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/e8a0966fbf474f0fa63a0f5c48bda549 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e8a0966fbf474f0fa63a0f5c48bda549 2023-11-02 21:57:17,564 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8a0966fbf474f0fa63a0f5c48bda549 2023-11-02 21:57:17,565 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 454cd05942026638919fcedce9e68ca5/family1 of 454cd05942026638919fcedce9e68ca5 into e8a0966fbf474f0fa63a0f5c48bda549(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:17,565 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:17,566 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:17,566 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 454cd05942026638919fcedce9e68ca5/family2 is initiating major compaction (all files) 2023-11-02 21:57:17,566 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:17,566 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:17,566 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 454cd05942026638919fcedce9e68ca5/family2 in testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:17,566 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c0441b139ac644c78bfc0e67b12841ca, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7b3de60474f941ba99c32f361c38a0f0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c682338388994c998ba19a99397aa2a1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/dc91a1a8c98e4b0881ccb1cf93d58c25, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7aa3d0f314594bb3a4f1129b39456c3d] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp, totalSize=25.4 K 2023-11-02 21:57:17,567 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting c0441b139ac644c78bfc0e67b12841ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219482 2023-11-02 21:57:17,567 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 7b3de60474f941ba99c32f361c38a0f0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221483 2023-11-02 21:57:17,568 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting c682338388994c998ba19a99397aa2a1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223545 2023-11-02 21:57:17,568 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting dc91a1a8c98e4b0881ccb1cf93d58c25, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225481 2023-11-02 21:57:17,569 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 7aa3d0f314594bb3a4f1129b39456c3d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-02 21:57:17,580 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 454cd05942026638919fcedce9e68ca5#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:17,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/2e237e52069c459b870bb650ad8b650c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e3c0e2e20b12497081e3718420251a17, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e835f2cfb63c42209cb7a01958349057, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/d456e6ec03af47d78913c6d95f23a2a3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/6ba68588c49c4419952b46609e4a7510] to archive 2023-11-02 21:57:17,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:17,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/2e237e52069c459b870bb650ad8b650c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/2e237e52069c459b870bb650ad8b650c 2023-11-02 21:57:17,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e3c0e2e20b12497081e3718420251a17 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e3c0e2e20b12497081e3718420251a17 2023-11-02 21:57:17,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e835f2cfb63c42209cb7a01958349057 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e835f2cfb63c42209cb7a01958349057 2023-11-02 21:57:17,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/d456e6ec03af47d78913c6d95f23a2a3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/d456e6ec03af47d78913c6d95f23a2a3 2023-11-02 21:57:17,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/6ba68588c49c4419952b46609e4a7510 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/6ba68588c49c4419952b46609e4a7510 2023-11-02 21:57:17,993 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311020b53ebfbdde242f693d10b924d3fdf86_del 2023-11-02 21:57:17,993 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311020b53ebfbdde242f693d10b924d3fdf86_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020b53ebfbdde242f693d10b924d3fdf86_del 2023-11-02 21:57:18,823 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6f0842d93e64facaa0dc34acce91e59 2023-11-02 21:57:18,824 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/d6f0842d93e64facaa0dc34acce91e59 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/d6f0842d93e64facaa0dc34acce91e59 2023-11-02 21:57:18,831 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6f0842d93e64facaa0dc34acce91e59 2023-11-02 21:57:18,832 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 454cd05942026638919fcedce9e68ca5/family2 of 454cd05942026638919fcedce9e68ca5 into d6f0842d93e64facaa0dc34acce91e59(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:18,832 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:18,838 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:18,842 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:18,849 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:18,850 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:18,856 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-02 21:57:18,890 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-02 21:57:18,893 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311025c53f5790f924a138a6534a882797132_del 2023-11-02 21:57:18,896 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110250f20b3c811246baa9f1e5c8714e173a_del 2023-11-02 21:57:18,900 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231102dc74f787146f4078b4bbe55ce198a577_del 2023-11-02 21:57:18,900 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:18,902 DEBUG [Listener at localhost/34483] zookeeper.ReadOnlyZKClient(139): Connect 0x5cdcb4db to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:57:18,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c0441b139ac644c78bfc0e67b12841ca, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7b3de60474f941ba99c32f361c38a0f0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c682338388994c998ba19a99397aa2a1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/dc91a1a8c98e4b0881ccb1cf93d58c25, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7aa3d0f314594bb3a4f1129b39456c3d] to archive 2023-11-02 21:57:18,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:18,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c0441b139ac644c78bfc0e67b12841ca to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c0441b139ac644c78bfc0e67b12841ca 2023-11-02 21:57:18,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7b3de60474f941ba99c32f361c38a0f0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7b3de60474f941ba99c32f361c38a0f0 2023-11-02 21:57:18,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c682338388994c998ba19a99397aa2a1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/c682338388994c998ba19a99397aa2a1 2023-11-02 21:57:18,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/dc91a1a8c98e4b0881ccb1cf93d58c25 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/dc91a1a8c98e4b0881ccb1cf93d58c25 2023-11-02 21:57:18,915 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7aa3d0f314594bb3a4f1129b39456c3d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/7aa3d0f314594bb3a4f1129b39456c3d 2023-11-02 21:57:18,975 DEBUG [Listener at localhost/34483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c6387cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:57:18,975 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:18,976 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:18,976 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:19,434 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110211484211506f4ac9aa184985a455668b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110211484211506f4ac9aa184985a455668b 2023-11-02 21:57:19,435 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:19,448 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:57:19,451 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:51454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:57:19,458 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:57:19,460 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:50060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:57:19,468 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231102/family1/35ac19113a864268ae736f542916dddb first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-02 21:57:19,469 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231102/family1/35ac19113a864268ae736f542916dddb}] 2023-11-02 21:57:19,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231102/family1/35ac19113a864268ae736f542916dddb for inclusion in 454cd05942026638919fcedce9e68ca5/family1 2023-11-02 21:57:19,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-02 21:57:19,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-02 21:57:19,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:19,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231102/family1/35ac19113a864268ae736f542916dddb to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__bbgohb5361b19j0v60uqap257l5jpn96369bd3is95no94oai5mqj79h46m2qhqh/family1/35ac19113a864268ae736f542916dddb 2023-11-02 21:57:19,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__bbgohb5361b19j0v60uqap257l5jpn96369bd3is95no94oai5mqj79h46m2qhqh/family1/35ac19113a864268ae736f542916dddb as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/5a22d6bc9ab74c24a14ec07f99a69df4_SeqId_29_ 2023-11-02 21:57:19,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__bbgohb5361b19j0v60uqap257l5jpn96369bd3is95no94oai5mqj79h46m2qhqh/family1/35ac19113a864268ae736f542916dddb into 454cd05942026638919fcedce9e68ca5/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/5a22d6bc9ab74c24a14ec07f99a69df4_SeqId_29_ - updating store file list. 2023-11-02 21:57:19,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/5a22d6bc9ab74c24a14ec07f99a69df4_SeqId_29_ into 454cd05942026638919fcedce9e68ca5/family1 2023-11-02 21:57:19,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__bbgohb5361b19j0v60uqap257l5jpn96369bd3is95no94oai5mqj79h46m2qhqh/family1/35ac19113a864268ae736f542916dddb into 454cd05942026638919fcedce9e68ca5/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/5a22d6bc9ab74c24a14ec07f99a69df4_SeqId_29_) 2023-11-02 21:57:19,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__bbgohb5361b19j0v60uqap257l5jpn96369bd3is95no94oai5mqj79h46m2qhqh/family1/35ac19113a864268ae736f542916dddb 2023-11-02 21:57:19,485 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:19,486 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:19,487 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311025424dd532c8c4e389d9d631213d584fd to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311025424dd532c8c4e389d9d631213d584fd 2023-11-02 21:57:19,488 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311027003d2a3c4ff45178d583fba2bc57146 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311027003d2a3c4ff45178d583fba2bc57146 2023-11-02 21:57:19,489 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102ac547861f979418a8685b5e98dcc18f5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102ac547861f979418a8685b5e98dcc18f5 2023-11-02 21:57:19,490 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102b634842f9dea468cbd0ec0ec91e6acdc to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102b634842f9dea468cbd0ec0ec91e6acdc 2023-11-02 21:57:19,490 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-02 21:57:19,490 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231102' 2023-11-02 21:57:19,491 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:19,842 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102a1bdc726906043ac86f6c51571d68ee1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102a1bdc726906043ac86f6c51571d68ee1 2023-11-02 21:57:19,842 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311025bded93e84fa4a9492467b73f8e772e8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311025bded93e84fa4a9492467b73f8e772e8 2023-11-02 21:57:19,843 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:19,843 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:19,867 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231102/family1/8940d782016740a08cd15fdfa4974d7c first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-02 21:57:19,867 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231102/family1/50ee74e136cb44a29f6a6d0169578a42 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-02 21:57:19,869 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231102/family1/8940d782016740a08cd15fdfa4974d7c}] 2023-11-02 21:57:19,869 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231102/family1/50ee74e136cb44a29f6a6d0169578a42}] 2023-11-02 21:57:19,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231102/family1/50ee74e136cb44a29f6a6d0169578a42 for inclusion in e92d97a5fce63a593b6e19d1ce049ed1/family1 2023-11-02 21:57:19,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231102/family1/8940d782016740a08cd15fdfa4974d7c for inclusion in 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 2023-11-02 21:57:19,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-02 21:57:19,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-02 21:57:19,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-02 21:57:19,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last=1 2023-11-02 21:57:19,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:19,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:19,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231102/family1/50ee74e136cb44a29f6a6d0169578a42 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__6kmbvuhjipjbjph7mt81r8vujc19g8j6epk4ujgqma9ir8ssnd8lk69gj0j8ketm/family1/50ee74e136cb44a29f6a6d0169578a42 2023-11-02 21:57:19,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231102/family1/8940d782016740a08cd15fdfa4974d7c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__4rf0cvsm38b396saa7lnc7b648uetgqn09a9rrkepfj3n7uqoi17fdrbkev3d4lc/family1/8940d782016740a08cd15fdfa4974d7c 2023-11-02 21:57:19,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__6kmbvuhjipjbjph7mt81r8vujc19g8j6epk4ujgqma9ir8ssnd8lk69gj0j8ketm/family1/50ee74e136cb44a29f6a6d0169578a42 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/a20e7f89236640fba6a39642ca540c3a_SeqId_29_ 2023-11-02 21:57:19,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__4rf0cvsm38b396saa7lnc7b648uetgqn09a9rrkepfj3n7uqoi17fdrbkev3d4lc/family1/8940d782016740a08cd15fdfa4974d7c as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/e90d269d77eb4aa78dc807e96588f0da_SeqId_29_ 2023-11-02 21:57:19,877 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__6kmbvuhjipjbjph7mt81r8vujc19g8j6epk4ujgqma9ir8ssnd8lk69gj0j8ketm/family1/50ee74e136cb44a29f6a6d0169578a42 into e92d97a5fce63a593b6e19d1ce049ed1/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/a20e7f89236640fba6a39642ca540c3a_SeqId_29_ - updating store file list. 2023-11-02 21:57:19,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__4rf0cvsm38b396saa7lnc7b648uetgqn09a9rrkepfj3n7uqoi17fdrbkev3d4lc/family1/8940d782016740a08cd15fdfa4974d7c into 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/e90d269d77eb4aa78dc807e96588f0da_SeqId_29_ - updating store file list. 2023-11-02 21:57:19,881 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/a20e7f89236640fba6a39642ca540c3a_SeqId_29_ into e92d97a5fce63a593b6e19d1ce049ed1/family1 2023-11-02 21:57:19,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/e90d269d77eb4aa78dc807e96588f0da_SeqId_29_ into 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 2023-11-02 21:57:19,881 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__6kmbvuhjipjbjph7mt81r8vujc19g8j6epk4ujgqma9ir8ssnd8lk69gj0j8ketm/family1/50ee74e136cb44a29f6a6d0169578a42 into e92d97a5fce63a593b6e19d1ce049ed1/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/a20e7f89236640fba6a39642ca540c3a_SeqId_29_) 2023-11-02 21:57:19,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__4rf0cvsm38b396saa7lnc7b648uetgqn09a9rrkepfj3n7uqoi17fdrbkev3d4lc/family1/8940d782016740a08cd15fdfa4974d7c into 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/e90d269d77eb4aa78dc807e96588f0da_SeqId_29_) 2023-11-02 21:57:19,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__6kmbvuhjipjbjph7mt81r8vujc19g8j6epk4ujgqma9ir8ssnd8lk69gj0j8ketm/family1/50ee74e136cb44a29f6a6d0169578a42 2023-11-02 21:57:19,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__4rf0cvsm38b396saa7lnc7b648uetgqn09a9rrkepfj3n7uqoi17fdrbkev3d4lc/family1/8940d782016740a08cd15fdfa4974d7c 2023-11-02 21:57:19,883 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:19,883 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:19,884 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:19,884 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:19,885 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102097e0a8c68f042799a8159cebe992a3c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102097e0a8c68f042799a8159cebe992a3c 2023-11-02 21:57:19,885 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311026263a75a724a4c48b6f8ca0361c09826 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311026263a75a724a4c48b6f8ca0361c09826 2023-11-02 21:57:19,886 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102166a86e12ef8486e8359c4608307a331 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102166a86e12ef8486e8359c4608307a331 2023-11-02 21:57:19,886 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311028dab142c14584251a5877015268751d1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311028dab142c14584251a5877015268751d1 2023-11-02 21:57:19,886 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102221d5173092c40dbb3e3968cd4b64c3b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102221d5173092c40dbb3e3968cd4b64c3b 2023-11-02 21:57:19,886 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102a0534c275a1c47c0bc70f6b61a693598 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102a0534c275a1c47c0bc70f6b61a693598 2023-11-02 21:57:19,887 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311026cec23cd08644e39a32214fd597f0ad4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311026cec23cd08644e39a32214fd597f0ad4 2023-11-02 21:57:19,887 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-02 21:57:19,887 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231102' 2023-11-02 21:57:19,887 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102acd189c881b648719a86dcf5141355e3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102acd189c881b648719a86dcf5141355e3 2023-11-02 21:57:19,887 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-02 21:57:19,887 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231102' 2023-11-02 21:57:19,887 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:19,887 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:19,887 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:19,888 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:19,888 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311025c53f5790f924a138a6534a882797132_del] 2023-11-02 21:57:19,888 DEBUG [Listener at localhost/34483] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:19,889 DEBUG [Listener at localhost/34483] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311025c53f5790f924a138a6534a882797132_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311025c53f5790f924a138a6534a882797132_del 2023-11-02 21:57:19,889 INFO [Listener at localhost/34483] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-02 21:57:19,889 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110250f20b3c811246baa9f1e5c8714e173a_del] 2023-11-02 21:57:19,889 DEBUG [Listener at localhost/34483] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:19,890 DEBUG [Listener at localhost/34483] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110250f20b3c811246baa9f1e5c8714e173a_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110250f20b3c811246baa9f1e5c8714e173a_del 2023-11-02 21:57:19,890 INFO [Listener at localhost/34483] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-02 21:57:19,890 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102dc74f787146f4078b4bbe55ce198a577_del] 2023-11-02 21:57:19,890 DEBUG [Listener at localhost/34483] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:19,891 DEBUG [Listener at localhost/34483] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102dc74f787146f4078b4bbe55ce198a577_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102dc74f787146f4078b4bbe55ce198a577_del 2023-11-02 21:57:19,891 INFO [Listener at localhost/34483] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-02 21:57:19,894 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:19,896 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:19,901 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:19,902 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:19,908 INFO [Listener at localhost/34483] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-02 21:57:19,909 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.HMaster$11(2418): Client=jenkins//136.243.104.168 disable testCompactionWithHFileLink 2023-11-02 21:57:19,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-02 21:57:19,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-02 21:57:19,912 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962239912"}]},"ts":"1698962239912"} 2023-11-02 21:57:19,914 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-02 21:57:19,984 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-02 21:57:19,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, UNASSIGN}] 2023-11-02 21:57:19,988 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, UNASSIGN 2023-11-02 21:57:19,989 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, UNASSIGN 2023-11-02 21:57:19,989 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, UNASSIGN 2023-11-02 21:57:19,990 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=e92d97a5fce63a593b6e19d1ce049ed1, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:19,990 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962239990"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962239990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962239990"}]},"ts":"1698962239990"} 2023-11-02 21:57:19,990 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=8cb793f0a9b02d274d44d3bfb0a21f4c, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:19,990 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=454cd05942026638919fcedce9e68ca5, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:19,990 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962239990"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962239990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962239990"}]},"ts":"1698962239990"} 2023-11-02 21:57:19,991 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962239990"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962239990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962239990"}]},"ts":"1698962239990"} 2023-11-02 21:57:19,992 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure e92d97a5fce63a593b6e19d1ce049ed1, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:57:19,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 454cd05942026638919fcedce9e68ca5, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:57:19,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 8cb793f0a9b02d274d44d3bfb0a21f4c, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:57:20,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-02 21:57:20,144 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:20,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(111): Close 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:20,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 8cb793f0a9b02d274d44d3bfb0a21f4c, disabling compactions & flushes 2023-11-02 21:57:20,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:20,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:20,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. after waiting 0 ms 2023-11-02 21:57:20,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:20,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-02 21:57:20,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:20,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:20,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(149): Closed 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:20,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(111): Close 454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:20,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 454cd05942026638919fcedce9e68ca5, disabling compactions & flushes 2023-11-02 21:57:20,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:20,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:20,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. after waiting 0 ms 2023-11-02 21:57:20,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:20,160 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=8cb793f0a9b02d274d44d3bfb0a21f4c, regionState=CLOSED 2023-11-02 21:57:20,160 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962240160"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962240160"}]},"ts":"1698962240160"} 2023-11-02 21:57:20,170 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=89 2023-11-02 21:57:20,170 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 8cb793f0a9b02d274d44d3bfb0a21f4c, server=jenkins-hbase12.apache.org,33583,1698962105160 in 174 msec 2023-11-02 21:57:20,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, UNASSIGN in 185 msec 2023-11-02 21:57:20,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-02 21:57:20,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:20,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:20,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(149): Closed 454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:20,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(111): Close e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:20,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing e92d97a5fce63a593b6e19d1ce049ed1, disabling compactions & flushes 2023-11-02 21:57:20,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:20,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:20,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. after waiting 0 ms 2023-11-02 21:57:20,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:20,174 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=454cd05942026638919fcedce9e68ca5, regionState=CLOSED 2023-11-02 21:57:20,174 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962240174"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962240174"}]},"ts":"1698962240174"} 2023-11-02 21:57:20,179 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-11-02 21:57:20,179 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure 454cd05942026638919fcedce9e68ca5, server=jenkins-hbase12.apache.org,33583,1698962105160 in 184 msec 2023-11-02 21:57:20,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, UNASSIGN in 193 msec 2023-11-02 21:57:20,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-02 21:57:20,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:20,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:20,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(149): Closed e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:20,183 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=e92d97a5fce63a593b6e19d1ce049ed1, regionState=CLOSED 2023-11-02 21:57:20,183 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962240183"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962240183"}]},"ts":"1698962240183"} 2023-11-02 21:57:20,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-11-02 21:57:20,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure e92d97a5fce63a593b6e19d1ce049ed1, server=jenkins-hbase12.apache.org,33583,1698962105160 in 192 msec 2023-11-02 21:57:20,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=90, resume processing ppid=88 2023-11-02 21:57:20,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, UNASSIGN in 199 msec 2023-11-02 21:57:20,187 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962240187"}]},"ts":"1698962240187"} 2023-11-02 21:57:20,188 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-02 21:57:20,194 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-02 21:57:20,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 286 msec 2023-11-02 21:57:20,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-02 21:57:20,214 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-02 21:57:20,224 INFO [Listener at localhost/34483] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1698962227477-1698962240224 2023-11-02 21:57:20,225 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1583): Client=jenkins//136.243.104.168 snapshot request for:{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-02 21:57:20,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698962240225 (current time:1698962240225). 2023-11-02 21:57:20,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-02 21:57:20,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] zookeeper.ReadOnlyZKClient(139): Connect 0x1f855c9c to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:57:20,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73268900, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:57:20,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:57:20,241 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:41138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:57:20,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f855c9c to 127.0.0.1:49550 2023-11-02 21:57:20,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:57:20,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-02 21:57:20,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-02 21:57:20,248 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot, current working dir path: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698962227477-1698962240224 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-02 21:57:20,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-02 21:57:20,252 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-02 21:57:20,252 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698962840252 2023-11-02 21:57:20,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-02 21:57:20,252 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1698962227477-1698962240224 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-02 21:57:20,253 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:20,253 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-02 21:57:20,353 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-02 21:57:20,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-02 21:57:20,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-02 21:57:20,356 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-02 21:57:20,557 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-02 21:57:20,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-02 21:57:20,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-02 21:57:20,559 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-02 21:57:20,662 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-02 21:57:20,665 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-02 21:57:20,665 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-02 21:57:20,665 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-02 21:57:20,666 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-02 21:57:20,665 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-02 21:57:20,666 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-02 21:57:20,666 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-02 21:57:20,665 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/37ee3319937a441f9031fd95a0ba6ffa, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/e90d269d77eb4aa78dc807e96588f0da_SeqId_29_] hfiles 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/91fae927f6254deaa1ea7562d19cd4b2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/a20e7f89236640fba6a39642ca540c3a_SeqId_29_] hfiles 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/5a22d6bc9ab74c24a14ec07f99a69df4_SeqId_29_, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e8a0966fbf474f0fa63a0f5c48bda549] hfiles 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/91fae927f6254deaa1ea7562d19cd4b2 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/37ee3319937a441f9031fd95a0ba6ffa 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/a20e7f89236640fba6a39642ca540c3a_SeqId_29_ 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/5a22d6bc9ab74c24a14ec07f99a69df4_SeqId_29_ 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/e90d269d77eb4aa78dc807e96588f0da_SeqId_29_ 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e8a0966fbf474f0fa63a0f5c48bda549 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102a1bdc726906043ac86f6c51571d68ee1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110211484211506f4ac9aa184985a455668b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311025bded93e84fa4a9492467b73f8e772e8] hfiles 2023-11-02 21:57:20,671 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102a1bdc726906043ac86f6c51571d68ee1 2023-11-02 21:57:20,672 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110211484211506f4ac9aa184985a455668b 2023-11-02 21:57:20,672 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311025bded93e84fa4a9492467b73f8e772e8 2023-11-02 21:57:20,672 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/1b16bad097eb4a2ead1f00192805155f] hfiles 2023-11-02 21:57:20,672 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/1b16bad097eb4a2ead1f00192805155f 2023-11-02 21:57:20,672 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/1b211b69bad344829b57c20164c4b829] hfiles 2023-11-02 21:57:20,672 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/d6f0842d93e64facaa0dc34acce91e59] hfiles 2023-11-02 21:57:20,672 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/d6f0842d93e64facaa0dc34acce91e59 2023-11-02 21:57:20,672 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/1b211b69bad344829b57c20164c4b829 2023-11-02 21:57:20,679 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311022820230baffa4682a6c94031f4ab21af, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110273ad67dc4c7a482295f4614761ad4fc1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102862cb5e4d7254e3cb1cd5b14759bb7e7, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102ac786ca976dd478bbcdca4701c3cc967, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102ec17fee1f0c346699a0e253e471faa84_del, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020578b0d06f4047ceb7f6a3f8b21f5407, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020b53ebfbdde242f693d10b924d3fdf86_del, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020c36c83628dc4032a15d80b5ae491c33, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231102db18a370d8bd45c2a1934873de26bc15, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231102ed2cdd2fd0d343a9aea1369c61a79f68, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102311906feacd04d909df7e3633f8e49c3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311027684f3496d354d02ac06d38a0398456d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110299a44a9b3eee46d5b56609ba1d93061d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102b0e45cf8564f483d94299e55522bc2f5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102b7807901397c4d399e99d4f365049500_del] hfiles 2023-11-02 21:57:20,679 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311022820230baffa4682a6c94031f4ab21af 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110273ad67dc4c7a482295f4614761ad4fc1 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102862cb5e4d7254e3cb1cd5b14759bb7e7 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102ac786ca976dd478bbcdca4701c3cc967 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102ec17fee1f0c346699a0e253e471faa84_del 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020578b0d06f4047ceb7f6a3f8b21f5407 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020b53ebfbdde242f693d10b924d3fdf86_del 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020c36c83628dc4032a15d80b5ae491c33 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231102db18a370d8bd45c2a1934873de26bc15 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231102ed2cdd2fd0d343a9aea1369c61a79f68 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102311906feacd04d909df7e3633f8e49c3 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311027684f3496d354d02ac06d38a0398456d 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110299a44a9b3eee46d5b56609ba1d93061d 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102b0e45cf8564f483d94299e55522bc2f5 2023-11-02 21:57:20,680 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102b7807901397c4d399e99d4f365049500_del 2023-11-02 21:57:20,859 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-02 21:57:20,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-02 21:57:20,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-02 21:57:20,862 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-02 21:57:21,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-02 21:57:21,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1698962227477-1698962240224 2023-11-02 21:57:21,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698962227477-1698962240224 2023-11-02 21:57:21,362 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-02 21:57:21,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-02 21:57:21,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-02 21:57:21,365 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-02 21:57:21,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698962227477-1698962240224 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/hbase-failsafe-snaptb-1698962227477-1698962240224 2023-11-02 21:57:21,513 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1698962227477-1698962240224 of table testCompactionWithHFileLink completed 2023-11-02 21:57:21,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698962227477-1698962240224 2023-11-02 21:57:21,513 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698962227477-1698962240224 2023-11-02 21:57:21,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1698962227477-1698962240224 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698962240253Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1698962240662 (+409 ms)Consolidate snapshot: hbase-failsafe-snaptb-1698962227477-1698962240224 at 1698962241085 (+423 ms)Loading Region manifests for hbase-failsafe-snaptb-1698962227477-1698962240224 at 1698962241085Writing data manifest for hbase-failsafe-snaptb-1698962227477-1698962240224 at 1698962241091 (+6 ms)Verifying snapshot: hbase-failsafe-snaptb-1698962227477-1698962240224 at 1698962241500 (+409 ms)Snapshot hbase-failsafe-snaptb-1698962227477-1698962240224 of table testCompactionWithHFileLink completed at 1698962241513 (+13 ms) 2023-11-02 21:57:21,514 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-02 21:57:21,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2640 sec 2023-11-02 21:57:22,365 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-02 21:57:22,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-02 21:57:22,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1698962227477-1698962240224 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-02 21:57:22,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698962227477" table: "testCompactionWithHFileLink" creation_time: 1698962227489 type: FLUSH version: 2 ttl: 0 ) 2023-11-02 21:57:22,407 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1698962227477 as table=testCompactionWithHFileLink 2023-11-02 21:57:22,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-02 21:57:22,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-02 21:57:22,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-02 21:57:22,817 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-02 21:57:22,818 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-02 21:57:22,818 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-02 21:57:22,819 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-02 21:57:22,826 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1698962227477" table: "testCompactionWithHFileLink" creation_time: 1698962227489 type: FLUSH version: 2 ttl: 0 2023-11-02 21:57:22,826 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink 2023-11-02 21:57:22,831 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-02 21:57:22,835 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110211484211506f4ac9aa184985a455668b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110211484211506f4ac9aa184985a455668b 2023-11-02 21:57:22,836 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311025bded93e84fa4a9492467b73f8e772e8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311025bded93e84fa4a9492467b73f8e772e8 2023-11-02 21:57:22,836 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102a1bdc726906043ac86f6c51571d68ee1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102a1bdc726906043ac86f6c51571d68ee1 2023-11-02 21:57:22,837 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231102097e0a8c68f042799a8159cebe992a3c of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,839 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231102166a86e12ef8486e8359c4608307a331 of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,842 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231102221d5173092c40dbb3e3968cd4b64c3b of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,846 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311026cec23cd08644e39a32214fd597f0ad4 of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,849 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311025424dd532c8c4e389d9d631213d584fd of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,853 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311027003d2a3c4ff45178d583fba2bc57146 of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,856 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231102ac547861f979418a8685b5e98dcc18f5 of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,860 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231102b634842f9dea468cbd0ec0ec91e6acdc of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,863 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311026263a75a724a4c48b6f8ca0361c09826 of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,866 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311028dab142c14584251a5877015268751d1 of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,868 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231102a0534c275a1c47c0bc70f6b61a693598 of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,870 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231102acd189c881b648719a86dcf5141355e3 of snapshot=snaptb-1698962227477 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-02 21:57:22,874 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102ec17fee1f0c346699a0e253e471faa84_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231102ec17fee1f0c346699a0e253e471faa84_del 2023-11-02 21:57:22,875 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020b53ebfbdde242f693d10b924d3fdf86_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311020b53ebfbdde242f693d10b924d3fdf86_del 2023-11-02 21:57:22,876 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102b7807901397c4d399e99d4f365049500_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231102b7807901397c4d399e99d4f365049500_del 2023-11-02 21:57:22,876 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:22,876 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:22,876 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:22,879 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/5a22d6bc9ab74c24a14ec07f99a69df4_SeqId_29_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/5a22d6bc9ab74c24a14ec07f99a69df4_SeqId_29_ 2023-11-02 21:57:22,879 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/91fae927f6254deaa1ea7562d19cd4b2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/91fae927f6254deaa1ea7562d19cd4b2 2023-11-02 21:57:22,880 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/37ee3319937a441f9031fd95a0ba6ffa to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/37ee3319937a441f9031fd95a0ba6ffa 2023-11-02 21:57:22,881 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e8a0966fbf474f0fa63a0f5c48bda549 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/e8a0966fbf474f0fa63a0f5c48bda549 2023-11-02 21:57:22,881 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2e237e52069c459b870bb650ad8b650c of snapshot=snaptb-1698962227477 to region=454cd05942026638919fcedce9e68ca5 table=testCompactionWithHFileLink 2023-11-02 21:57:22,881 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/a20e7f89236640fba6a39642ca540c3a_SeqId_29_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/a20e7f89236640fba6a39642ca540c3a_SeqId_29_ 2023-11-02 21:57:22,881 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5c7167f400834f81aeb00a99432501a4 of snapshot=snaptb-1698962227477 to region=e92d97a5fce63a593b6e19d1ce049ed1 table=testCompactionWithHFileLink 2023-11-02 21:57:22,881 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/e90d269d77eb4aa78dc807e96588f0da_SeqId_29_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/e90d269d77eb4aa78dc807e96588f0da_SeqId_29_ 2023-11-02 21:57:22,881 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 787fcae96a10496a81fcf126814cf8af of snapshot=snaptb-1698962227477 to region=8cb793f0a9b02d274d44d3bfb0a21f4c table=testCompactionWithHFileLink 2023-11-02 21:57:22,890 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e3c0e2e20b12497081e3718420251a17 of snapshot=snaptb-1698962227477 to region=454cd05942026638919fcedce9e68ca5 table=testCompactionWithHFileLink 2023-11-02 21:57:22,891 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3032660c3acd4a088d38f7119b15add6 of snapshot=snaptb-1698962227477 to region=8cb793f0a9b02d274d44d3bfb0a21f4c table=testCompactionWithHFileLink 2023-11-02 21:57:22,892 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3a77396452e949bdaa031b39ff65c846 of snapshot=snaptb-1698962227477 to region=e92d97a5fce63a593b6e19d1ce049ed1 table=testCompactionWithHFileLink 2023-11-02 21:57:22,894 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 18a533b01d9940f0a9fe13e571b385f5 of snapshot=snaptb-1698962227477 to region=8cb793f0a9b02d274d44d3bfb0a21f4c table=testCompactionWithHFileLink 2023-11-02 21:57:22,894 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e835f2cfb63c42209cb7a01958349057 of snapshot=snaptb-1698962227477 to region=454cd05942026638919fcedce9e68ca5 table=testCompactionWithHFileLink 2023-11-02 21:57:22,895 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2d9852452ca04fe185383d0279718d4b of snapshot=snaptb-1698962227477 to region=e92d97a5fce63a593b6e19d1ce049ed1 table=testCompactionWithHFileLink 2023-11-02 21:57:22,896 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0d56ed6ce0564ee1a7e3b36eeab14fe3 of snapshot=snaptb-1698962227477 to region=8cb793f0a9b02d274d44d3bfb0a21f4c table=testCompactionWithHFileLink 2023-11-02 21:57:22,896 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d456e6ec03af47d78913c6d95f23a2a3 of snapshot=snaptb-1698962227477 to region=454cd05942026638919fcedce9e68ca5 table=testCompactionWithHFileLink 2023-11-02 21:57:22,897 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2bd746d37a654a86a4241011c62693a0 of snapshot=snaptb-1698962227477 to region=e92d97a5fce63a593b6e19d1ce049ed1 table=testCompactionWithHFileLink 2023-11-02 21:57:22,900 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/d6f0842d93e64facaa0dc34acce91e59 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/d6f0842d93e64facaa0dc34acce91e59 2023-11-02 21:57:22,900 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c0441b139ac644c78bfc0e67b12841ca of snapshot=snaptb-1698962227477 to region=454cd05942026638919fcedce9e68ca5 table=testCompactionWithHFileLink 2023-11-02 21:57:22,900 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/1b16bad097eb4a2ead1f00192805155f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/1b16bad097eb4a2ead1f00192805155f 2023-11-02 21:57:22,900 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9323316882f34a2c94235b58ef89c8e0 of snapshot=snaptb-1698962227477 to region=8cb793f0a9b02d274d44d3bfb0a21f4c table=testCompactionWithHFileLink 2023-11-02 21:57:22,901 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/1b211b69bad344829b57c20164c4b829 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/1b211b69bad344829b57c20164c4b829 2023-11-02 21:57:22,901 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4d756e51562648fdb2cf3e7190f433e2 of snapshot=snaptb-1698962227477 to region=e92d97a5fce63a593b6e19d1ce049ed1 table=testCompactionWithHFileLink 2023-11-02 21:57:22,902 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7b3de60474f941ba99c32f361c38a0f0 of snapshot=snaptb-1698962227477 to region=454cd05942026638919fcedce9e68ca5 table=testCompactionWithHFileLink 2023-11-02 21:57:22,903 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b48e4659b11f4264ae324e13d8dc9bd2 of snapshot=snaptb-1698962227477 to region=8cb793f0a9b02d274d44d3bfb0a21f4c table=testCompactionWithHFileLink 2023-11-02 21:57:22,904 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c8f8d05377d54c999c399e899c77f90f of snapshot=snaptb-1698962227477 to region=e92d97a5fce63a593b6e19d1ce049ed1 table=testCompactionWithHFileLink 2023-11-02 21:57:22,910 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c682338388994c998ba19a99397aa2a1 of snapshot=snaptb-1698962227477 to region=454cd05942026638919fcedce9e68ca5 table=testCompactionWithHFileLink 2023-11-02 21:57:22,911 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 870e9d20c5d04aceb005625456982fd0 of snapshot=snaptb-1698962227477 to region=8cb793f0a9b02d274d44d3bfb0a21f4c table=testCompactionWithHFileLink 2023-11-02 21:57:22,912 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d8bbf46a711b4b8db58bfad4e20f39d9 of snapshot=snaptb-1698962227477 to region=e92d97a5fce63a593b6e19d1ce049ed1 table=testCompactionWithHFileLink 2023-11-02 21:57:22,913 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dc91a1a8c98e4b0881ccb1cf93d58c25 of snapshot=snaptb-1698962227477 to region=454cd05942026638919fcedce9e68ca5 table=testCompactionWithHFileLink 2023-11-02 21:57:22,913 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7e43d0ae81af471cb16b3e84939b032c of snapshot=snaptb-1698962227477 to region=8cb793f0a9b02d274d44d3bfb0a21f4c table=testCompactionWithHFileLink 2023-11-02 21:57:22,914 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 505b19834856471cb32c7a9acf96927b of snapshot=snaptb-1698962227477 to region=e92d97a5fce63a593b6e19d1ce049ed1 table=testCompactionWithHFileLink 2023-11-02 21:57:22,917 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1698962227477" table: "testCompactionWithHFileLink" creation_time: 1698962227489 type: FLUSH version: 2 ttl: 0 2023-11-02 21:57:22,918 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698962242917"}]},"ts":"9223372036854775807"} 2023-11-02 21:57:22,918 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698962242917"}]},"ts":"9223372036854775807"} 2023-11-02 21:57:22,918 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698962242917"}]},"ts":"9223372036854775807"} 2023-11-02 21:57:22,919 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-02 21:57:22,919 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 454cd05942026638919fcedce9e68ca5, NAME => 'testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 8cb793f0a9b02d274d44d3bfb0a21f4c, NAME => 'testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e92d97a5fce63a593b6e19d1ce049ed1, NAME => 'testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-02 21:57:22,919 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962242918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962242918"}]},"ts":"1698962242918"} 2023-11-02 21:57:22,919 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962242918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962242918"}]},"ts":"1698962242918"} 2023-11-02 21:57:22,919 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962242918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962242918"}]},"ts":"1698962242918"} 2023-11-02 21:57:22,921 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-02 21:57:22,921 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-02 21:57:22,921 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 454cd05942026638919fcedce9e68ca5, NAME => 'testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 8cb793f0a9b02d274d44d3bfb0a21f4c, NAME => 'testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e92d97a5fce63a593b6e19d1ce049ed1, NAME => 'testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-02 21:57:22,921 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1698962227477 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-02 21:57:22,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698962227477" table: "testCompactionWithHFileLink" creation_time: 1698962227489 type: FLUSH version: 2 ttl: 0 ) in 522 msec 2023-11-02 21:57:23,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-02 21:57:23,016 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-02 21:57:23,016 INFO [Listener at localhost/34483] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1698962227477-1698962240224 2023-11-02 21:57:23,023 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(751): Client=jenkins//136.243.104.168 delete name: "hbase-failsafe-snaptb-1698962227477-1698962240224" 2023-11-02 21:57:23,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1698962227477-1698962240224 2023-11-02 21:57:23,030 INFO [Listener at localhost/34483] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-02 21:57:23,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.HMaster$10(2385): Client=jenkins//136.243.104.168 enable testCompactionWithHFileLink 2023-11-02 21:57:23,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-02 21:57:23,043 INFO [PEWorker-4] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-02 21:57:23,043 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962243043"}]},"ts":"1698962243043"} 2023-11-02 21:57:23,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-02 21:57:23,044 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-02 21:57:23,069 DEBUG [PEWorker-4] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-02 21:57:23,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, ASSIGN}] 2023-11-02 21:57:23,072 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, ASSIGN 2023-11-02 21:57:23,072 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, ASSIGN 2023-11-02 21:57:23,073 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, ASSIGN 2023-11-02 21:57:23,074 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-02 21:57:23,074 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-02 21:57:23,074 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-02 21:57:23,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-02 21:57:23,226 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=454cd05942026638919fcedce9e68ca5, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:23,226 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=8cb793f0a9b02d274d44d3bfb0a21f4c, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:23,226 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962243226"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962243226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962243226"}]},"ts":"1698962243226"} 2023-11-02 21:57:23,226 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=e92d97a5fce63a593b6e19d1ce049ed1, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:23,226 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962243226"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962243226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962243226"}]},"ts":"1698962243226"} 2023-11-02 21:57:23,226 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962243226"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962243226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962243226"}]},"ts":"1698962243226"} 2023-11-02 21:57:23,228 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 454cd05942026638919fcedce9e68ca5, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:57:23,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 8cb793f0a9b02d274d44d3bfb0a21f4c, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:57:23,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure e92d97a5fce63a593b6e19d1ce049ed1, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:57:23,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-02 21:57:23,380 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:23,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:23,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8cb793f0a9b02d274d44d3bfb0a21f4c, NAME => 'testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.', STARTKEY => '', ENDKEY => '1'} 2023-11-02 21:57:23,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:23,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:23,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:23,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:23,390 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:23,392 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1 2023-11-02 21:57:23,392 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1 2023-11-02 21:57:23,392 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb793f0a9b02d274d44d3bfb0a21f4c columnFamilyName family1 2023-11-02 21:57:23,408 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-0d56ed6ce0564ee1a7e3b36eeab14fe3 2023-11-02 21:57:23,417 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-18a533b01d9940f0a9fe13e571b385f5 2023-11-02 21:57:23,425 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-3032660c3acd4a088d38f7119b15add6 2023-11-02 21:57:23,436 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-787fcae96a10496a81fcf126814cf8af 2023-11-02 21:57:23,436 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(310): Store=8cb793f0a9b02d274d44d3bfb0a21f4c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:23,436 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:23,437 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2 2023-11-02 21:57:23,437 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2 2023-11-02 21:57:23,438 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb793f0a9b02d274d44d3bfb0a21f4c columnFamilyName family2 2023-11-02 21:57:23,444 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-7e43d0ae81af471cb16b3e84939b032c 2023-11-02 21:57:23,449 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-870e9d20c5d04aceb005625456982fd0 2023-11-02 21:57:23,455 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-9323316882f34a2c94235b58ef89c8e0 2023-11-02 21:57:23,461 DEBUG [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-b48e4659b11f4264ae324e13d8dc9bd2 2023-11-02 21:57:23,461 INFO [StoreOpener-8cb793f0a9b02d274d44d3bfb0a21f4c-1] regionserver.HStore(310): Store=8cb793f0a9b02d274d44d3bfb0a21f4c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:23,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:23,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:23,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:57:23,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:57:23,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 8cb793f0a9b02d274d44d3bfb0a21f4c; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62269165, jitterRate=-0.07211713492870331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:57:23,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:23,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c., pid=102, masterSystemTime=1698962243380 2023-11-02 21:57:23,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:57:23,467 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-02 21:57:23,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-02 21:57:23,467 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-02 21:57:23,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:23,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:23,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:23,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e92d97a5fce63a593b6e19d1ce049ed1, NAME => 'testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.', STARTKEY => '1', ENDKEY => '2'} 2023-11-02 21:57:23,469 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=8cb793f0a9b02d274d44d3bfb0a21f4c, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:23,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:23,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:23,470 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962243469"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962243469"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962243469"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962243469"}]},"ts":"1698962243469"} 2023-11-02 21:57:23,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:23,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:23,471 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-02 21:57:23,471 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1912): 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 is initiating minor compaction (all files) 2023-11-02 21:57:23,471 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:23,471 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 in testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:23,471 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-787fcae96a10496a81fcf126814cf8af, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-3032660c3acd4a088d38f7119b15add6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-18a533b01d9940f0a9fe13e571b385f5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-0d56ed6ce0564ee1a7e3b36eeab14fe3] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp, totalSize=21.6 K 2023-11-02 21:57:23,471 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-02 21:57:23,471 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HStore(1912): 8cb793f0a9b02d274d44d3bfb0a21f4c/family2 is initiating minor compaction (all files) 2023-11-02 21:57:23,472 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 8cb793f0a9b02d274d44d3bfb0a21f4c/family2 in testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:57:23,472 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-9323316882f34a2c94235b58ef89c8e0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-b48e4659b11f4264ae324e13d8dc9bd2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-870e9d20c5d04aceb005625456982fd0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-7e43d0ae81af471cb16b3e84939b032c] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp, totalSize=20.4 K 2023-11-02 21:57:23,472 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-787fcae96a10496a81fcf126814cf8af, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219481 2023-11-02 21:57:23,472 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1 2023-11-02 21:57:23,472 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1 2023-11-02 21:57:23,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=98 2023-11-02 21:57:23,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 8cb793f0a9b02d274d44d3bfb0a21f4c, server=jenkins-hbase12.apache.org,33583,1698962105160 in 242 msec 2023-11-02 21:57:23,472 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-9323316882f34a2c94235b58ef89c8e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219481 2023-11-02 21:57:23,473 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e92d97a5fce63a593b6e19d1ce049ed1 columnFamilyName family1 2023-11-02 21:57:23,473 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-3032660c3acd4a088d38f7119b15add6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221482 2023-11-02 21:57:23,473 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-b48e4659b11f4264ae324e13d8dc9bd2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221482 2023-11-02 21:57:23,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb793f0a9b02d274d44d3bfb0a21f4c, ASSIGN in 403 msec 2023-11-02 21:57:23,474 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-18a533b01d9940f0a9fe13e571b385f5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223544 2023-11-02 21:57:23,474 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-870e9d20c5d04aceb005625456982fd0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223544 2023-11-02 21:57:23,475 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-0d56ed6ce0564ee1a7e3b36eeab14fe3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225480 2023-11-02 21:57:23,475 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-7e43d0ae81af471cb16b3e84939b032c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225480 2023-11-02 21:57:23,490 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2bd746d37a654a86a4241011c62693a0 2023-11-02 21:57:23,497 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2d9852452ca04fe185383d0279718d4b 2023-11-02 21:57:23,504 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-3a77396452e949bdaa031b39ff65c846 2023-11-02 21:57:23,505 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8cb793f0a9b02d274d44d3bfb0a21f4c#family1#compaction#114 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-11-02 21:57:23,505 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] throttle.PressureAwareThroughputController(145): 8cb793f0a9b02d274d44d3bfb0a21f4c#family2#compaction#115 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-02 21:57:23,513 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-5c7167f400834f81aeb00a99432501a4 2023-11-02 21:57:23,513 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(310): Store=e92d97a5fce63a593b6e19d1ce049ed1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:23,513 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:23,514 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2 2023-11-02 21:57:23,514 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2 2023-11-02 21:57:23,514 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e92d97a5fce63a593b6e19d1ce049ed1 columnFamilyName family2 2023-11-02 21:57:23,520 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-4d756e51562648fdb2cf3e7190f433e2 2023-11-02 21:57:23,524 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-505b19834856471cb32c7a9acf96927b 2023-11-02 21:57:23,529 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-c8f8d05377d54c999c399e899c77f90f 2023-11-02 21:57:23,533 DEBUG [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-d8bbf46a711b4b8db58bfad4e20f39d9 2023-11-02 21:57:23,533 INFO [StoreOpener-e92d97a5fce63a593b6e19d1ce049ed1-1] regionserver.HStore(310): Store=e92d97a5fce63a593b6e19d1ce049ed1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:23,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:23,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:23,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:57:23,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:57:23,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened e92d97a5fce63a593b6e19d1ce049ed1; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60576242, jitterRate=-0.09734365344047546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:57:23,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:23,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1., pid=103, masterSystemTime=1698962243380 2023-11-02 21:57:23,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-02 21:57:23,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-02 21:57:23,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:23,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:23,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:23,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 454cd05942026638919fcedce9e68ca5, NAME => 'testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.', STARTKEY => '2', ENDKEY => ''} 2023-11-02 21:57:23,540 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=e92d97a5fce63a593b6e19d1ce049ed1, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:23,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:23,540 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962243540"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962243540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962243540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962243540"}]},"ts":"1698962243540"} 2023-11-02 21:57:23,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:23,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:23,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:23,541 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:23,542 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1 2023-11-02 21:57:23,542 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1 2023-11-02 21:57:23,542 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 454cd05942026638919fcedce9e68ca5 columnFamilyName family1 2023-11-02 21:57:23,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=99 2023-11-02 21:57:23,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure e92d97a5fce63a593b6e19d1ce049ed1, server=jenkins-hbase12.apache.org,33583,1698962105160 in 311 msec 2023-11-02 21:57:23,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e92d97a5fce63a593b6e19d1ce049ed1, ASSIGN in 473 msec 2023-11-02 21:57:23,548 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-2e237e52069c459b870bb650ad8b650c 2023-11-02 21:57:23,552 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-d456e6ec03af47d78913c6d95f23a2a3 2023-11-02 21:57:23,556 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e3c0e2e20b12497081e3718420251a17 2023-11-02 21:57:23,561 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e835f2cfb63c42209cb7a01958349057 2023-11-02 21:57:23,561 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(310): Store=454cd05942026638919fcedce9e68ca5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:23,561 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:23,562 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2 2023-11-02 21:57:23,562 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2 2023-11-02 21:57:23,562 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 454cd05942026638919fcedce9e68ca5 columnFamilyName family2 2023-11-02 21:57:23,569 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-7b3de60474f941ba99c32f361c38a0f0 2023-11-02 21:57:23,573 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c0441b139ac644c78bfc0e67b12841ca 2023-11-02 21:57:23,578 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c682338388994c998ba19a99397aa2a1 2023-11-02 21:57:23,582 DEBUG [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(539): loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-dc91a1a8c98e4b0881ccb1cf93d58c25 2023-11-02 21:57:23,582 INFO [StoreOpener-454cd05942026638919fcedce9e68ca5-1] regionserver.HStore(310): Store=454cd05942026638919fcedce9e68ca5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:23,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:23,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:23,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:57:23,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 454cd05942026638919fcedce9e68ca5 2023-11-02 21:57:23,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 454cd05942026638919fcedce9e68ca5; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66203936, jitterRate=-0.013484477996826172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:57:23,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:23,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5., pid=101, masterSystemTime=1698962243380 2023-11-02 21:57:23,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-02 21:57:23,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-02 21:57:23,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:23,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:23,589 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=454cd05942026638919fcedce9e68ca5, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:23,589 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698962243588"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962243588"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962243588"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962243588"}]},"ts":"1698962243588"} 2023-11-02 21:57:23,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-11-02 21:57:23,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 454cd05942026638919fcedce9e68ca5, server=jenkins-hbase12.apache.org,33583,1698962105160 in 362 msec 2023-11-02 21:57:23,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=97 2023-11-02 21:57:23,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=454cd05942026638919fcedce9e68ca5, ASSIGN in 521 msec 2023-11-02 21:57:23,593 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962243593"}]},"ts":"1698962243593"} 2023-11-02 21:57:23,594 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-02 21:57:23,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-02 21:57:23,657 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-02 21:57:23,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 622 msec 2023-11-02 21:57:24,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-02 21:57:24,151 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-02 21:57:24,172 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:24,182 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:24,192 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:24,192 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:24,198 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-02 21:57:24,210 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-02 21:57:24,210 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:24,211 DEBUG [Listener at localhost/34483] zookeeper.ReadOnlyZKClient(139): Connect 0x1fea47f2 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:57:24,258 DEBUG [Listener at localhost/34483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38c0c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:57:24,258 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:24,258 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:24,258 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:24,708 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102d75d5b2a2f6a4ba2be6c0ff0ae52275f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231102d75d5b2a2f6a4ba2be6c0ff0ae52275f 2023-11-02 21:57:24,708 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:24,719 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:57:24,721 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:41142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:57:24,729 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:57:24,733 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family1/39a8370d73d6456296b3a2629f14d842 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/39a8370d73d6456296b3a2629f14d842 2023-11-02 21:57:24,733 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:52462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:57:24,737 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/.tmp/family2/565b66887de74bf0bf4f539b70b6e970 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/565b66887de74bf0bf4f539b70b6e970 2023-11-02 21:57:24,738 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 of 8cb793f0a9b02d274d44d3bfb0a21f4c into 39a8370d73d6456296b3a2629f14d842(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:24,738 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:24,738 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c., storeName=8cb793f0a9b02d274d44d3bfb0a21f4c/family1, priority=12, startTime=1698962243466; duration=1sec 2023-11-02 21:57:24,739 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-02 21:57:24,739 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-02 21:57:24,741 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-02 21:57:24,742 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1912): e92d97a5fce63a593b6e19d1ce049ed1/family1 is initiating minor compaction (all files) 2023-11-02 21:57:24,742 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e92d97a5fce63a593b6e19d1ce049ed1/family1 in testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:24,742 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-5c7167f400834f81aeb00a99432501a4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-3a77396452e949bdaa031b39ff65c846, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2d9852452ca04fe185383d0279718d4b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2bd746d37a654a86a4241011c62693a0] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp, totalSize=21.6 K 2023-11-02 21:57:24,742 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-5c7167f400834f81aeb00a99432501a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219482 2023-11-02 21:57:24,743 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 8cb793f0a9b02d274d44d3bfb0a21f4c/family2 of 8cb793f0a9b02d274d44d3bfb0a21f4c into 565b66887de74bf0bf4f539b70b6e970(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:24,743 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:24,743 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c., storeName=8cb793f0a9b02d274d44d3bfb0a21f4c/family2, priority=12, startTime=1698962243467; duration=1sec 2023-11-02 21:57:24,743 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-02 21:57:24,743 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-3a77396452e949bdaa031b39ff65c846, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221482 2023-11-02 21:57:24,743 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2d9852452ca04fe185383d0279718d4b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223545 2023-11-02 21:57:24,748 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-02 21:57:24,749 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2bd746d37a654a86a4241011c62693a0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225480 2023-11-02 21:57:24,750 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-02 21:57:24,751 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HStore(1912): 454cd05942026638919fcedce9e68ca5/family2 is initiating minor compaction (all files) 2023-11-02 21:57:24,751 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 454cd05942026638919fcedce9e68ca5/family2 in testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:24,751 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c0441b139ac644c78bfc0e67b12841ca, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-7b3de60474f941ba99c32f361c38a0f0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c682338388994c998ba19a99397aa2a1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-dc91a1a8c98e4b0881ccb1cf93d58c25] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp, totalSize=20.4 K 2023-11-02 21:57:24,751 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c0441b139ac644c78bfc0e67b12841ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219482 2023-11-02 21:57:24,753 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-7b3de60474f941ba99c32f361c38a0f0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221483 2023-11-02 21:57:24,754 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c682338388994c998ba19a99397aa2a1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223545 2023-11-02 21:57:24,755 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231102/family1/ec0c614742964e629e53eab58cd8a6cb first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-02 21:57:24,756 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231102/family1/ec0c614742964e629e53eab58cd8a6cb}] 2023-11-02 21:57:24,756 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-dc91a1a8c98e4b0881ccb1cf93d58c25, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225481 2023-11-02 21:57:24,762 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231102/family1/ec0c614742964e629e53eab58cd8a6cb for inclusion in 454cd05942026638919fcedce9e68ca5/family1 2023-11-02 21:57:24,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-02 21:57:24,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-02 21:57:24,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:24,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231102/family1/ec0c614742964e629e53eab58cd8a6cb to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__4cavpdtkt37d08r2aef5jh0mufqn6pe4n2ic19v9qlmi260n8i2vom9t6i5mnanm/family1/ec0c614742964e629e53eab58cd8a6cb 2023-11-02 21:57:24,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__4cavpdtkt37d08r2aef5jh0mufqn6pe4n2ic19v9qlmi260n8i2vom9t6i5mnanm/family1/ec0c614742964e629e53eab58cd8a6cb as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/8cb7207692924fc89b0ddefa0b63bd58_SeqId_34_ 2023-11-02 21:57:24,768 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__4cavpdtkt37d08r2aef5jh0mufqn6pe4n2ic19v9qlmi260n8i2vom9t6i5mnanm/family1/ec0c614742964e629e53eab58cd8a6cb into 454cd05942026638919fcedce9e68ca5/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/8cb7207692924fc89b0ddefa0b63bd58_SeqId_34_ - updating store file list. 2023-11-02 21:57:24,769 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): e92d97a5fce63a593b6e19d1ce049ed1#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-02 21:57:24,771 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/8cb7207692924fc89b0ddefa0b63bd58_SeqId_34_ into 454cd05942026638919fcedce9e68ca5/family1 2023-11-02 21:57:24,771 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__4cavpdtkt37d08r2aef5jh0mufqn6pe4n2ic19v9qlmi260n8i2vom9t6i5mnanm/family1/ec0c614742964e629e53eab58cd8a6cb into 454cd05942026638919fcedce9e68ca5/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/8cb7207692924fc89b0ddefa0b63bd58_SeqId_34_) 2023-11-02 21:57:24,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__4cavpdtkt37d08r2aef5jh0mufqn6pe4n2ic19v9qlmi260n8i2vom9t6i5mnanm/family1/ec0c614742964e629e53eab58cd8a6cb 2023-11-02 21:57:24,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:24,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-02 21:57:24,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(1912): 454cd05942026638919fcedce9e68ca5/family1 is initiating minor compaction (all files) 2023-11-02 21:57:24,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1f5190ef; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-02 21:57:24,776 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:24,777 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:24,778 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311025424dd532c8c4e389d9d631213d584fd to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311025424dd532c8c4e389d9d631213d584fd 2023-11-02 21:57:24,779 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311027003d2a3c4ff45178d583fba2bc57146 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311027003d2a3c4ff45178d583fba2bc57146 2023-11-02 21:57:24,779 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] throttle.PressureAwareThroughputController(145): 454cd05942026638919fcedce9e68ca5#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-02 21:57:24,781 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231102ac547861f979418a8685b5e98dcc18f5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231102ac547861f979418a8685b5e98dcc18f5 2023-11-02 21:57:24,782 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231102b634842f9dea468cbd0ec0ec91e6acdc to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231102b634842f9dea468cbd0ec0ec91e6acdc 2023-11-02 21:57:24,782 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-02 21:57:24,782 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231102' 2023-11-02 21:57:24,782 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:24,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-787fcae96a10496a81fcf126814cf8af, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-3032660c3acd4a088d38f7119b15add6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-18a533b01d9940f0a9fe13e571b385f5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-0d56ed6ce0564ee1a7e3b36eeab14fe3] to archive 2023-11-02 21:57:24,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:24,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-787fcae96a10496a81fcf126814cf8af to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-787fcae96a10496a81fcf126814cf8af 2023-11-02 21:57:24,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-3032660c3acd4a088d38f7119b15add6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-3032660c3acd4a088d38f7119b15add6 2023-11-02 21:57:24,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-18a533b01d9940f0a9fe13e571b385f5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-18a533b01d9940f0a9fe13e571b385f5 2023-11-02 21:57:24,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-0d56ed6ce0564ee1a7e3b36eeab14fe3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-0d56ed6ce0564ee1a7e3b36eeab14fe3 2023-11-02 21:57:24,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-9323316882f34a2c94235b58ef89c8e0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-b48e4659b11f4264ae324e13d8dc9bd2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-870e9d20c5d04aceb005625456982fd0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-7e43d0ae81af471cb16b3e84939b032c] to archive 2023-11-02 21:57:24,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:24,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-9323316882f34a2c94235b58ef89c8e0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-9323316882f34a2c94235b58ef89c8e0 2023-11-02 21:57:24,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-b48e4659b11f4264ae324e13d8dc9bd2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-b48e4659b11f4264ae324e13d8dc9bd2 2023-11-02 21:57:24,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-870e9d20c5d04aceb005625456982fd0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-870e9d20c5d04aceb005625456982fd0 2023-11-02 21:57:24,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-7e43d0ae81af471cb16b3e84939b032c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family2/testCompactionWithHFileLink=8cb793f0a9b02d274d44d3bfb0a21f4c-7e43d0ae81af471cb16b3e84939b032c 2023-11-02 21:57:25,110 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102c03e898d61ba42a4bc7e75cbc9756723 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231102c03e898d61ba42a4bc7e75cbc9756723 2023-11-02 21:57:25,112 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:25,114 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102465785d97a0b4a9ca27d94cea836d45f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231102465785d97a0b4a9ca27d94cea836d45f 2023-11-02 21:57:25,115 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:25,147 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231102/family1/0ff1ac7cba3443a1a848f81cfe3380b2 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-02 21:57:25,147 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231102/family1/7461254348504b62a459ba484e8a8334 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-02 21:57:25,148 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231102/family1/0ff1ac7cba3443a1a848f81cfe3380b2}] 2023-11-02 21:57:25,148 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=32 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231102/family1/7461254348504b62a459ba484e8a8334}] 2023-11-02 21:57:25,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231102/family1/7461254348504b62a459ba484e8a8334 for inclusion in 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 2023-11-02 21:57:25,151 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231102/family1/0ff1ac7cba3443a1a848f81cfe3380b2 for inclusion in e92d97a5fce63a593b6e19d1ce049ed1/family1 2023-11-02 21:57:25,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-02 21:57:25,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-02 21:57:25,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last=1 2023-11-02 21:57:25,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-02 21:57:25,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:57:25,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:25,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231102/family1/7461254348504b62a459ba484e8a8334 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__f933rqmeaac15d0n5d3bcapajsfmphkv3bl23gtbeeh2o9j3lqlopvvqkipotlg1/family1/7461254348504b62a459ba484e8a8334 2023-11-02 21:57:25,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231102/family1/0ff1ac7cba3443a1a848f81cfe3380b2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__6s8k808v1usv14f26ppc683hqhr0o8bj7eeq4m9ua9b839h6n2pan26mujg0hjes/family1/0ff1ac7cba3443a1a848f81cfe3380b2 2023-11-02 21:57:25,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__f933rqmeaac15d0n5d3bcapajsfmphkv3bl23gtbeeh2o9j3lqlopvvqkipotlg1/family1/7461254348504b62a459ba484e8a8334 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/278beb37ee954ad1928551a0a80f6723_SeqId_36_ 2023-11-02 21:57:25,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__6s8k808v1usv14f26ppc683hqhr0o8bj7eeq4m9ua9b839h6n2pan26mujg0hjes/family1/0ff1ac7cba3443a1a848f81cfe3380b2 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/c165beb5e3cd4adab0e8dbdf684f3db9_SeqId_34_ 2023-11-02 21:57:25,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__f933rqmeaac15d0n5d3bcapajsfmphkv3bl23gtbeeh2o9j3lqlopvvqkipotlg1/family1/7461254348504b62a459ba484e8a8334 into 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/278beb37ee954ad1928551a0a80f6723_SeqId_36_ - updating store file list. 2023-11-02 21:57:25,155 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__6s8k808v1usv14f26ppc683hqhr0o8bj7eeq4m9ua9b839h6n2pan26mujg0hjes/family1/0ff1ac7cba3443a1a848f81cfe3380b2 into e92d97a5fce63a593b6e19d1ce049ed1/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/c165beb5e3cd4adab0e8dbdf684f3db9_SeqId_34_ - updating store file list. 2023-11-02 21:57:25,158 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/c165beb5e3cd4adab0e8dbdf684f3db9_SeqId_34_ into e92d97a5fce63a593b6e19d1ce049ed1/family1 2023-11-02 21:57:25,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/278beb37ee954ad1928551a0a80f6723_SeqId_36_ into 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 2023-11-02 21:57:25,158 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__6s8k808v1usv14f26ppc683hqhr0o8bj7eeq4m9ua9b839h6n2pan26mujg0hjes/family1/0ff1ac7cba3443a1a848f81cfe3380b2 into e92d97a5fce63a593b6e19d1ce049ed1/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/c165beb5e3cd4adab0e8dbdf684f3db9_SeqId_34_) 2023-11-02 21:57:25,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__f933rqmeaac15d0n5d3bcapajsfmphkv3bl23gtbeeh2o9j3lqlopvvqkipotlg1/family1/7461254348504b62a459ba484e8a8334 into 8cb793f0a9b02d274d44d3bfb0a21f4c/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/family1/278beb37ee954ad1928551a0a80f6723_SeqId_36_) 2023-11-02 21:57:25,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__6s8k808v1usv14f26ppc683hqhr0o8bj7eeq4m9ua9b839h6n2pan26mujg0hjes/family1/0ff1ac7cba3443a1a848f81cfe3380b2 2023-11-02 21:57:25,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testCompactionWithHFileLink__f933rqmeaac15d0n5d3bcapajsfmphkv3bl23gtbeeh2o9j3lqlopvvqkipotlg1/family1/7461254348504b62a459ba484e8a8334 2023-11-02 21:57:25,160 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:25,160 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231102 table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:25,161 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:25,161 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:25,162 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231102097e0a8c68f042799a8159cebe992a3c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231102097e0a8c68f042799a8159cebe992a3c 2023-11-02 21:57:25,162 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311026263a75a724a4c48b6f8ca0361c09826 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311026263a75a724a4c48b6f8ca0361c09826 2023-11-02 21:57:25,163 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231102166a86e12ef8486e8359c4608307a331 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231102166a86e12ef8486e8359c4608307a331 2023-11-02 21:57:25,163 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311028dab142c14584251a5877015268751d1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311028dab142c14584251a5877015268751d1 2023-11-02 21:57:25,163 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231102221d5173092c40dbb3e3968cd4b64c3b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231102221d5173092c40dbb3e3968cd4b64c3b 2023-11-02 21:57:25,164 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231102a0534c275a1c47c0bc70f6b61a693598 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231102a0534c275a1c47c0bc70f6b61a693598 2023-11-02 21:57:25,164 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311026cec23cd08644e39a32214fd597f0ad4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311026cec23cd08644e39a32214fd597f0ad4 2023-11-02 21:57:25,164 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-02 21:57:25,164 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231102' 2023-11-02 21:57:25,164 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231102acd189c881b648719a86dcf5141355e3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231102acd189c881b648719a86dcf5141355e3 2023-11-02 21:57:25,164 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-02 21:57:25,164 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231102' 2023-11-02 21:57:25,165 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:25,165 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231102 for table='testCompactionWithHFileLink' and column='family1' 2023-11-02 21:57:25,165 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-02 21:57:25,170 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:25,172 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:25,176 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:25,177 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:25,189 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:25,190 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:25,209 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=288 (was 239) - Thread LEAK? -, OpenFileDescriptor=791 (was 628) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=118 (was 102) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 174), AvailableMemoryMB=292 (was 311) 2023-11-02 21:57:25,220 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=286, OpenFileDescriptor=791, MaxFileDescriptor=60000, SystemLoadAverage=118, ProcessCount=173, AvailableMemoryMB=292 2023-11-02 21:57:25,226 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.HMaster$15(3014): Client=jenkins//136.243.104.168 creating {NAME => 'ns'} 2023-11-02 21:57:25,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-02 21:57:25,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-02 21:57:25,327 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-02 21:57:25,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-02 21:57:25,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 125 msec 2023-11-02 21:57:25,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-02 21:57:25,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-02 21:57:25,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-02 21:57:25,540 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:57:25,540 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-02 21:57:25,541 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:57:25,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-02 21:57:25,544 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:57:25,544 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:57:25,544 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a 2023-11-02 21:57:25,545 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191 empty. 2023-11-02 21:57:25,545 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590 empty. 2023-11-02 21:57:25,545 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a empty. 2023-11-02 21:57:25,546 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:57:25,546 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:57:25,546 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a 2023-11-02 21:57:25,546 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-02 21:57:25,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-02 21:57:25,695 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:57:25,725 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:57:25,726 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fea47f2 to 127.0.0.1:49550 2023-11-02 21:57:25,726 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:57:25,726 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:57:25,726 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55b0fed4 to 127.0.0.1:49550 2023-11-02 21:57:25,726 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:57:25,726 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:57:25,726 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cdcb4db to 127.0.0.1:49550 2023-11-02 21:57:25,726 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:57:25,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-02 21:57:25,957 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-02 21:57:25,960 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 173673ee4b2ff5cef47c017ea56e3191, NAME => 'ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:57:25,960 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 8868577134076e1bd90135190764517a, NAME => 'ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:57:25,961 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => d124ffa7fff84dce506beb288e8a5590, NAME => 'ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:57:26,005 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family1/dd606a4bc9294238b6e43e466317cf21 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/dd606a4bc9294238b6e43e466317cf21 2023-11-02 21:57:26,010 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family2/810c1f455fbf4c4da30d7ca474d02fab as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/810c1f455fbf4c4da30d7ca474d02fab 2023-11-02 21:57:26,011 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in e92d97a5fce63a593b6e19d1ce049ed1/family1 of e92d97a5fce63a593b6e19d1ce049ed1 into dd606a4bc9294238b6e43e466317cf21(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:26,011 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:26,011 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1., storeName=e92d97a5fce63a593b6e19d1ce049ed1/family1, priority=12, startTime=1698962243538; duration=1sec 2023-11-02 21:57:26,011 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-02 21:57:26,011 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 454cd05942026638919fcedce9e68ca5/family1 in testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:57:26,011 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-2e237e52069c459b870bb650ad8b650c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e3c0e2e20b12497081e3718420251a17, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e835f2cfb63c42209cb7a01958349057, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-d456e6ec03af47d78913c6d95f23a2a3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/8cb7207692924fc89b0ddefa0b63bd58_SeqId_34_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp, totalSize=28.9 K 2023-11-02 21:57:26,012 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-2e237e52069c459b870bb650ad8b650c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219482 2023-11-02 21:57:26,013 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e3c0e2e20b12497081e3718420251a17, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221483 2023-11-02 21:57:26,013 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e835f2cfb63c42209cb7a01958349057, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223545 2023-11-02 21:57:26,014 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-d456e6ec03af47d78913c6d95f23a2a3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225481 2023-11-02 21:57:26,015 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 8cb7207692924fc89b0ddefa0b63bd58_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698962219482 2023-11-02 21:57:26,017 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 454cd05942026638919fcedce9e68ca5/family2 of 454cd05942026638919fcedce9e68ca5 into 810c1f455fbf4c4da30d7ca474d02fab(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:26,017 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:26,017 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5., storeName=454cd05942026638919fcedce9e68ca5/family2, priority=12, startTime=1698962243587; duration=1sec 2023-11-02 21:57:26,017 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-02 21:57:26,017 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-11-02 21:57:26,017 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-02 21:57:26,017 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-02 21:57:26,017 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. because compaction request was cancelled 2023-11-02 21:57:26,018 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-02 21:57:26,020 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-02 21:57:26,020 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HStore(1912): e92d97a5fce63a593b6e19d1ce049ed1/family2 is initiating minor compaction (all files) 2023-11-02 21:57:26,020 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HRegion(2259): Starting compaction of e92d97a5fce63a593b6e19d1ce049ed1/family2 in testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:57:26,020 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-4d756e51562648fdb2cf3e7190f433e2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-c8f8d05377d54c999c399e899c77f90f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-d8bbf46a711b4b8db58bfad4e20f39d9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-505b19834856471cb32c7a9acf96927b] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp, totalSize=20.4 K 2023-11-02 21:57:26,021 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-4d756e51562648fdb2cf3e7190f433e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962219482 2023-11-02 21:57:26,022 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-c8f8d05377d54c999c399e899c77f90f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962221482 2023-11-02 21:57:26,023 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-d8bbf46a711b4b8db58bfad4e20f39d9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962223545 2023-11-02 21:57:26,024 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-505b19834856471cb32c7a9acf96927b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962225480 2023-11-02 21:57:26,029 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 454cd05942026638919fcedce9e68ca5#family1#compaction#118 average throughput is 2.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-02 21:57:26,034 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] throttle.PressureAwareThroughputController(145): e92d97a5fce63a593b6e19d1ce049ed1#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-02 21:57:26,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-5c7167f400834f81aeb00a99432501a4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-3a77396452e949bdaa031b39ff65c846, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2d9852452ca04fe185383d0279718d4b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2bd746d37a654a86a4241011c62693a0] to archive 2023-11-02 21:57:26,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:26,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-5c7167f400834f81aeb00a99432501a4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-5c7167f400834f81aeb00a99432501a4 2023-11-02 21:57:26,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-3a77396452e949bdaa031b39ff65c846 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-3a77396452e949bdaa031b39ff65c846 2023-11-02 21:57:26,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2d9852452ca04fe185383d0279718d4b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2d9852452ca04fe185383d0279718d4b 2023-11-02 21:57:26,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2bd746d37a654a86a4241011c62693a0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family1/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-2bd746d37a654a86a4241011c62693a0 2023-11-02 21:57:26,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c0441b139ac644c78bfc0e67b12841ca, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-7b3de60474f941ba99c32f361c38a0f0, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c682338388994c998ba19a99397aa2a1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-dc91a1a8c98e4b0881ccb1cf93d58c25] to archive 2023-11-02 21:57:26,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:26,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c0441b139ac644c78bfc0e67b12841ca to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c0441b139ac644c78bfc0e67b12841ca 2023-11-02 21:57:26,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-7b3de60474f941ba99c32f361c38a0f0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-7b3de60474f941ba99c32f361c38a0f0 2023-11-02 21:57:26,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c682338388994c998ba19a99397aa2a1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-c682338388994c998ba19a99397aa2a1 2023-11-02 21:57:26,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-dc91a1a8c98e4b0881ccb1cf93d58c25 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family2/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-dc91a1a8c98e4b0881ccb1cf93d58c25 2023-11-02 21:57:26,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 8868577134076e1bd90135190764517a, disabling compactions & flushes 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 173673ee4b2ff5cef47c017ea56e3191, disabling compactions & flushes 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:26,369 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. after waiting 0 ms 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing d124ffa7fff84dce506beb288e8a5590, disabling compactions & flushes 2023-11-02 21:57:26,369 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:26,369 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. after waiting 0 ms 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:26,369 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:57:26,369 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:26,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. after waiting 0 ms 2023-11-02 21:57:26,370 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:26,370 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:57:26,370 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:26,370 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:57:26,371 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:57:26,372 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698962246372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962246372"}]},"ts":"1698962246372"} 2023-11-02 21:57:26,372 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698962246372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962246372"}]},"ts":"1698962246372"} 2023-11-02 21:57:26,373 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698962246372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962246372"}]},"ts":"1698962246372"} 2023-11-02 21:57:26,374 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-02 21:57:26,375 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:57:26,375 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962246375"}]},"ts":"1698962246375"} 2023-11-02 21:57:26,376 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-02 21:57:26,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=173673ee4b2ff5cef47c017ea56e3191, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d124ffa7fff84dce506beb288e8a5590, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8868577134076e1bd90135190764517a, ASSIGN}] 2023-11-02 21:57:26,492 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8868577134076e1bd90135190764517a, ASSIGN 2023-11-02 21:57:26,492 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d124ffa7fff84dce506beb288e8a5590, ASSIGN 2023-11-02 21:57:26,492 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=173673ee4b2ff5cef47c017ea56e3191, ASSIGN 2023-11-02 21:57:26,493 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8868577134076e1bd90135190764517a, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:57:26,493 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d124ffa7fff84dce506beb288e8a5590, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:57:26,494 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=173673ee4b2ff5cef47c017ea56e3191, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:57:26,646 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d124ffa7fff84dce506beb288e8a5590, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:26,646 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=173673ee4b2ff5cef47c017ea56e3191, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:26,646 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=8868577134076e1bd90135190764517a, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:26,647 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698962246646"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962246646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962246646"}]},"ts":"1698962246646"} 2023-11-02 21:57:26,647 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698962246646"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962246646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962246646"}]},"ts":"1698962246646"} 2023-11-02 21:57:26,647 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698962246646"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962246646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962246646"}]},"ts":"1698962246646"} 2023-11-02 21:57:26,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-02 21:57:26,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure d124ffa7fff84dce506beb288e8a5590, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:57:26,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 8868577134076e1bd90135190764517a, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:57:26,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure 173673ee4b2ff5cef47c017ea56e3191, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:57:26,802 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:26,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:26,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8868577134076e1bd90135190764517a, NAME => 'ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a.', STARTKEY => '2', ENDKEY => ''} 2023-11-02 21:57:26,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 8868577134076e1bd90135190764517a 2023-11-02 21:57:26,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:26,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 8868577134076e1bd90135190764517a 2023-11-02 21:57:26,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 8868577134076e1bd90135190764517a 2023-11-02 21:57:26,811 INFO [StoreOpener-8868577134076e1bd90135190764517a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8868577134076e1bd90135190764517a 2023-11-02 21:57:26,813 DEBUG [StoreOpener-8868577134076e1bd90135190764517a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1 2023-11-02 21:57:26,813 DEBUG [StoreOpener-8868577134076e1bd90135190764517a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1 2023-11-02 21:57:26,814 INFO [StoreOpener-8868577134076e1bd90135190764517a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8868577134076e1bd90135190764517a columnFamilyName family1 2023-11-02 21:57:26,816 INFO [StoreOpener-8868577134076e1bd90135190764517a-1] regionserver.HStore(310): Store=8868577134076e1bd90135190764517a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:26,816 INFO [StoreOpener-8868577134076e1bd90135190764517a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8868577134076e1bd90135190764517a 2023-11-02 21:57:26,818 DEBUG [StoreOpener-8868577134076e1bd90135190764517a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2 2023-11-02 21:57:26,818 DEBUG [StoreOpener-8868577134076e1bd90135190764517a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2 2023-11-02 21:57:26,818 INFO [StoreOpener-8868577134076e1bd90135190764517a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8868577134076e1bd90135190764517a columnFamilyName family2 2023-11-02 21:57:26,820 INFO [StoreOpener-8868577134076e1bd90135190764517a-1] regionserver.HStore(310): Store=8868577134076e1bd90135190764517a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:26,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a 2023-11-02 21:57:26,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a 2023-11-02 21:57:26,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:57:26,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 8868577134076e1bd90135190764517a 2023-11-02 21:57:26,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:57:26,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 8868577134076e1bd90135190764517a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62632757, jitterRate=-0.06669919192790985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:57:26,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:57:26,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a., pid=110, masterSystemTime=1698962246801 2023-11-02 21:57:26,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:26,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:26,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:26,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 173673ee4b2ff5cef47c017ea56e3191, NAME => 'ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191.', STARTKEY => '', ENDKEY => '1'} 2023-11-02 21:57:26,832 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=8868577134076e1bd90135190764517a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:26,833 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698962246832"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962246832"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962246832"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962246832"}]},"ts":"1698962246832"} 2023-11-02 21:57:26,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:57:26,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:26,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:57:26,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:57:26,834 INFO [StoreOpener-173673ee4b2ff5cef47c017ea56e3191-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:57:26,836 DEBUG [StoreOpener-173673ee4b2ff5cef47c017ea56e3191-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1 2023-11-02 21:57:26,836 DEBUG [StoreOpener-173673ee4b2ff5cef47c017ea56e3191-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1 2023-11-02 21:57:26,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=108 2023-11-02 21:57:26,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 8868577134076e1bd90135190764517a, server=jenkins-hbase12.apache.org,33583,1698962105160 in 184 msec 2023-11-02 21:57:26,837 INFO [StoreOpener-173673ee4b2ff5cef47c017ea56e3191-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 173673ee4b2ff5cef47c017ea56e3191 columnFamilyName family1 2023-11-02 21:57:26,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8868577134076e1bd90135190764517a, ASSIGN in 348 msec 2023-11-02 21:57:26,837 INFO [StoreOpener-173673ee4b2ff5cef47c017ea56e3191-1] regionserver.HStore(310): Store=173673ee4b2ff5cef47c017ea56e3191/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:26,838 INFO [StoreOpener-173673ee4b2ff5cef47c017ea56e3191-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:57:26,839 DEBUG [StoreOpener-173673ee4b2ff5cef47c017ea56e3191-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2 2023-11-02 21:57:26,839 DEBUG [StoreOpener-173673ee4b2ff5cef47c017ea56e3191-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2 2023-11-02 21:57:26,839 INFO [StoreOpener-173673ee4b2ff5cef47c017ea56e3191-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 173673ee4b2ff5cef47c017ea56e3191 columnFamilyName family2 2023-11-02 21:57:26,839 INFO [StoreOpener-173673ee4b2ff5cef47c017ea56e3191-1] regionserver.HStore(310): Store=173673ee4b2ff5cef47c017ea56e3191/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:26,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:57:26,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:57:26,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:57:26,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:57:26,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:57:26,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 173673ee4b2ff5cef47c017ea56e3191; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62987526, jitterRate=-0.06141272187232971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:57:26,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:57:26,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191., pid=111, masterSystemTime=1698962246801 2023-11-02 21:57:26,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:26,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:26,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:26,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d124ffa7fff84dce506beb288e8a5590, NAME => 'ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590.', STARTKEY => '1', ENDKEY => '2'} 2023-11-02 21:57:26,847 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=173673ee4b2ff5cef47c017ea56e3191, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:26,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:57:26,847 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698962246847"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962246847"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962246847"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962246847"}]},"ts":"1698962246847"} 2023-11-02 21:57:26,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:26,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:57:26,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:57:26,848 INFO [StoreOpener-d124ffa7fff84dce506beb288e8a5590-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:57:26,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=106 2023-11-02 21:57:26,849 DEBUG [StoreOpener-d124ffa7fff84dce506beb288e8a5590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1 2023-11-02 21:57:26,850 DEBUG [StoreOpener-d124ffa7fff84dce506beb288e8a5590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1 2023-11-02 21:57:26,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure 173673ee4b2ff5cef47c017ea56e3191, server=jenkins-hbase12.apache.org,33583,1698962105160 in 197 msec 2023-11-02 21:57:26,850 INFO [StoreOpener-d124ffa7fff84dce506beb288e8a5590-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d124ffa7fff84dce506beb288e8a5590 columnFamilyName family1 2023-11-02 21:57:26,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=173673ee4b2ff5cef47c017ea56e3191, ASSIGN in 361 msec 2023-11-02 21:57:26,851 INFO [StoreOpener-d124ffa7fff84dce506beb288e8a5590-1] regionserver.HStore(310): Store=d124ffa7fff84dce506beb288e8a5590/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:26,851 INFO [StoreOpener-d124ffa7fff84dce506beb288e8a5590-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:57:26,852 DEBUG [StoreOpener-d124ffa7fff84dce506beb288e8a5590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2 2023-11-02 21:57:26,852 DEBUG [StoreOpener-d124ffa7fff84dce506beb288e8a5590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2 2023-11-02 21:57:26,853 INFO [StoreOpener-d124ffa7fff84dce506beb288e8a5590-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d124ffa7fff84dce506beb288e8a5590 columnFamilyName family2 2023-11-02 21:57:26,853 INFO [StoreOpener-d124ffa7fff84dce506beb288e8a5590-1] regionserver.HStore(310): Store=d124ffa7fff84dce506beb288e8a5590/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:26,853 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/.tmp/family2/f4e4fb145735405b8a411c40bdb85047 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/f4e4fb145735405b8a411c40bdb85047 2023-11-02 21:57:26,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:57:26,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:57:26,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:57:26,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:57:26,858 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in e92d97a5fce63a593b6e19d1ce049ed1/family2 of e92d97a5fce63a593b6e19d1ce049ed1 into f4e4fb145735405b8a411c40bdb85047(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:57:26,858 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:57:26,858 INFO [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1., storeName=e92d97a5fce63a593b6e19d1ce049ed1/family2, priority=12, startTime=1698962243538; duration=0sec 2023-11-02 21:57:26,858 DEBUG [RS:0;jenkins-hbase12:33583-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:57:26,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:57:26,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened d124ffa7fff84dce506beb288e8a5590; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59359286, jitterRate=-0.11547771096229553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:57:26,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:57:26,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590., pid=109, masterSystemTime=1698962246801 2023-11-02 21:57:26,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:26,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:26,861 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d124ffa7fff84dce506beb288e8a5590, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:26,861 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698962246861"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962246861"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962246861"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962246861"}]},"ts":"1698962246861"} 2023-11-02 21:57:26,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-11-02 21:57:26,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure d124ffa7fff84dce506beb288e8a5590, server=jenkins-hbase12.apache.org,33583,1698962105160 in 214 msec 2023-11-02 21:57:26,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-11-02 21:57:26,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d124ffa7fff84dce506beb288e8a5590, ASSIGN in 376 msec 2023-11-02 21:57:26,866 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:57:26,866 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962246866"}]},"ts":"1698962246866"} 2023-11-02 21:57:26,867 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-02 21:57:26,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-4d756e51562648fdb2cf3e7190f433e2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-c8f8d05377d54c999c399e899c77f90f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-d8bbf46a711b4b8db58bfad4e20f39d9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-505b19834856471cb32c7a9acf96927b] to archive 2023-11-02 21:57:26,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:26,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-4d756e51562648fdb2cf3e7190f433e2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-4d756e51562648fdb2cf3e7190f433e2 2023-11-02 21:57:26,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-c8f8d05377d54c999c399e899c77f90f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-c8f8d05377d54c999c399e899c77f90f 2023-11-02 21:57:26,921 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:57:26,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-d8bbf46a711b4b8db58bfad4e20f39d9 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-d8bbf46a711b4b8db58bfad4e20f39d9 2023-11-02 21:57:26,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.3840 sec 2023-11-02 21:57:26,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-505b19834856471cb32c7a9acf96927b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/family2/testCompactionWithHFileLink=e92d97a5fce63a593b6e19d1ce049ed1-505b19834856471cb32c7a9acf96927b 2023-11-02 21:57:27,258 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/.tmp/family1/91ef13d00c6f4b53bfa47f05e93a79dd as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/91ef13d00c6f4b53bfa47f05e93a79dd 2023-11-02 21:57:27,266 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 454cd05942026638919fcedce9e68ca5/family1 of 454cd05942026638919fcedce9e68ca5 into 91ef13d00c6f4b53bfa47f05e93a79dd(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 1sec, and took 1sec to execute. 2023-11-02 21:57:27,267 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:57:27,267 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698962244774; duration=1sec 2023-11-02 21:57:27,267 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:57:27,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-2e237e52069c459b870bb650ad8b650c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e3c0e2e20b12497081e3718420251a17, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e835f2cfb63c42209cb7a01958349057, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-d456e6ec03af47d78913c6d95f23a2a3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/8cb7207692924fc89b0ddefa0b63bd58_SeqId_34_] to archive 2023-11-02 21:57:27,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:27,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-2e237e52069c459b870bb650ad8b650c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-2e237e52069c459b870bb650ad8b650c 2023-11-02 21:57:27,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e3c0e2e20b12497081e3718420251a17 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e3c0e2e20b12497081e3718420251a17 2023-11-02 21:57:27,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e835f2cfb63c42209cb7a01958349057 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-e835f2cfb63c42209cb7a01958349057 2023-11-02 21:57:27,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-d456e6ec03af47d78913c6d95f23a2a3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/testCompactionWithHFileLink=454cd05942026638919fcedce9e68ca5-d456e6ec03af47d78913c6d95f23a2a3 2023-11-02 21:57:27,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/8cb7207692924fc89b0ddefa0b63bd58_SeqId_34_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/family1/8cb7207692924fc89b0ddefa0b63bd58_SeqId_34_ 2023-11-02 21:57:27,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-02 21:57:27,651 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-02 21:57:27,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:27,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:27,666 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:27,670 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:27,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-02 21:57:27,672 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-02 21:57:27,672 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:27,672 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-02 21:57:27,672 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-02 21:57:27,673 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:27,673 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:27,731 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:27,731 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:27,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:27,732 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:27,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:27,732 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:27,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:27,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:27,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:27,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-02 21:57:27,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-02 21:57:27,735 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-02 21:57:27,735 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:27,735 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-02 21:57:27,736 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:27,736 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. started... 2023-11-02 21:57:27,736 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:57:27,736 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:27,739 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8868577134076e1bd90135190764517a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-02 21:57:27,736 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:27,736 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:27,739 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. started... 2023-11-02 21:57:27,740 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. started... 2023-11-02 21:57:27,740 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d124ffa7fff84dce506beb288e8a5590 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-02 21:57:27,740 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 173673ee4b2ff5cef47c017ea56e3191 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-02 21:57:28,159 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311020b05badc43f145c98e8a16021b9d8dd6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311020b05badc43f145c98e8a16021b9d8dd6 2023-11-02 21:57:28,160 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102928edb7489e54da497f40f5e6e555e3b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231102928edb7489e54da497f40f5e6e555e3b 2023-11-02 21:57:28,160 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102a84fe3db4cde4c41aa1b46cbe7baa0ac to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231102a84fe3db4cde4c41aa1b46cbe7baa0ac 2023-11-02 21:57:28,565 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/0fce0436ec3d4ef4a661849bb9e8aae6 2023-11-02 21:57:28,567 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/844c18254a554491b436b5bc17f1fe5d 2023-11-02 21:57:28,567 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/cf64bcff49bc4d86ab9d9d74ac401b48 2023-11-02 21:57:28,990 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311025909c608ae0048ea81ed1308d04f5954 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311025909c608ae0048ea81ed1308d04f5954 2023-11-02 21:57:28,990 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102d40605f8005d4f859df7aa3712e030a5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231102d40605f8005d4f859df7aa3712e030a5 2023-11-02 21:57:28,990 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102beff3b09a4a84554932bb7cc14388c9c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231102beff3b09a4a84554932bb7cc14388c9c 2023-11-02 21:57:29,395 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/08c9f434b8a04f628d9b46222ba5dd70 2023-11-02 21:57:29,395 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/f9d48beb98cd44859df15daa24cf79a5 2023-11-02 21:57:29,396 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/cc906c04aa6d427388763c6a3feb16cc 2023-11-02 21:57:29,403 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/0fce0436ec3d4ef4a661849bb9e8aae6 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0fce0436ec3d4ef4a661849bb9e8aae6 2023-11-02 21:57:29,404 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/cf64bcff49bc4d86ab9d9d74ac401b48 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/cf64bcff49bc4d86ab9d9d74ac401b48 2023-11-02 21:57:29,404 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/844c18254a554491b436b5bc17f1fe5d as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/844c18254a554491b436b5bc17f1fe5d 2023-11-02 21:57:29,409 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/844c18254a554491b436b5bc17f1fe5d, entries=4, sequenceid=5, filesize=5.4 K 2023-11-02 21:57:29,409 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0fce0436ec3d4ef4a661849bb9e8aae6, entries=4, sequenceid=5, filesize=5.4 K 2023-11-02 21:57:29,409 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/cf64bcff49bc4d86ab9d9d74ac401b48, entries=4, sequenceid=5, filesize=5.4 K 2023-11-02 21:57:29,410 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/cc906c04aa6d427388763c6a3feb16cc as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/cc906c04aa6d427388763c6a3feb16cc 2023-11-02 21:57:29,410 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/f9d48beb98cd44859df15daa24cf79a5 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/f9d48beb98cd44859df15daa24cf79a5 2023-11-02 21:57:29,410 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/08c9f434b8a04f628d9b46222ba5dd70 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/08c9f434b8a04f628d9b46222ba5dd70 2023-11-02 21:57:29,414 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/cc906c04aa6d427388763c6a3feb16cc, entries=2, sequenceid=5, filesize=5.1 K 2023-11-02 21:57:29,414 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/f9d48beb98cd44859df15daa24cf79a5, entries=2, sequenceid=5, filesize=5.1 K 2023-11-02 21:57:29,414 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/08c9f434b8a04f628d9b46222ba5dd70, entries=2, sequenceid=5, filesize=5.1 K 2023-11-02 21:57:29,415 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 173673ee4b2ff5cef47c017ea56e3191 in 1675ms, sequenceid=5, compaction requested=false 2023-11-02 21:57:29,415 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d124ffa7fff84dce506beb288e8a5590 in 1675ms, sequenceid=5, compaction requested=false 2023-11-02 21:57:29,415 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8868577134076e1bd90135190764517a in 1676ms, sequenceid=5, compaction requested=false 2023-11-02 21:57:29,415 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-02 21:57:29,415 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-02 21:57:29,415 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-02 21:57:29,416 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:57:29,416 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:57:29,416 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:57:29,416 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:29,417 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:29,416 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:29,417 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:57:29,417 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:57:29,417 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:57:29,417 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:57:29,417 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,417 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-02 21:57:29,417 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-02 21:57:29,488 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,488 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:29,489 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:29,489 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:29,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-02 21:57:29,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@268b6a0b[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:29,491 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-02 21:57:29,491 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:29,499 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:29,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:29,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:29,499 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-02 21:57:29,499 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-02 21:57:29,499 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:29,499 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,499 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:29,509 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-02 21:57:29,509 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:29,509 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-02 21:57:29,509 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:29,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:29,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-02 21:57:29,518 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-02 21:57:29,518 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:29,518 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:29,518 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-02 21:57:29,518 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:29,530 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:29,530 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:29,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:29,530 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:29,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:29,532 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:29,534 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,540 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,540 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:29,540 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:29,541 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:29,541 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:29,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-02 21:57:29,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:29,541 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:29,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-02 21:57:29,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:29,541 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,541 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:29,541 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:29,541 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:29,541 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:29,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:29,541 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:29,641 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:29,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:29,644 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:29,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:29,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:29,648 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:29,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:29,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-02 21:57:29,651 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-02 21:57:29,651 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:29,651 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-02 21:57:29,651 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-02 21:57:29,652 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:29,652 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:29,656 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:29,656 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:29,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:29,657 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:29,657 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:29,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:29,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:29,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:29,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:29,659 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-02 21:57:29,660 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-02 21:57:29,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-02 21:57:29,660 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-02 21:57:29,660 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:29,660 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-02 21:57:29,660 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:29,660 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. started... 2023-11-02 21:57:29,660 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:29,660 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:57:29,661 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:29,661 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:29,661 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. started... 2023-11-02 21:57:29,661 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. started... 2023-11-02 21:57:29,661 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d124ffa7fff84dce506beb288e8a5590 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-02 21:57:29,661 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8868577134076e1bd90135190764517a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-02 21:57:29,661 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 173673ee4b2ff5cef47c017ea56e3191 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-02 21:57:30,078 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102f7e3950484274ac89b2898ab1c2ca24e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231102f7e3950484274ac89b2898ab1c2ca24e 2023-11-02 21:57:30,078 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110286c45acff1ec4d9aa3230ff1c5d17812 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023110286c45acff1ec4d9aa3230ff1c5d17812 2023-11-02 21:57:30,079 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110265397589fca846d181129189ab632a3f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023110265397589fca846d181129189ab632a3f 2023-11-02 21:57:30,486 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/fdc9d9b9cc9344e4825b718c7bc0f5e2 2023-11-02 21:57:30,534 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/66b56024472849ad9fd0199b4b80b3c4 2023-11-02 21:57:30,534 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/339ac8297d294a61904a61da74d49aa3 2023-11-02 21:57:30,551 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102894f4a1e917b4f46877f9267fdc36933 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231102894f4a1e917b4f46877f9267fdc36933 2023-11-02 21:57:30,956 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110230447d15d9224183a7705897507e6ca9 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023110230447d15d9224183a7705897507e6ca9 2023-11-02 21:57:30,957 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102162764a46d4d4bbd869493e6b0b45726 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231102162764a46d4d4bbd869493e6b0b45726 2023-11-02 21:57:30,958 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/a7b2150c83034286b79a6a6f7583a63a 2023-11-02 21:57:30,967 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/fdc9d9b9cc9344e4825b718c7bc0f5e2 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/fdc9d9b9cc9344e4825b718c7bc0f5e2 2023-11-02 21:57:30,970 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/fdc9d9b9cc9344e4825b718c7bc0f5e2, entries=4, sequenceid=9, filesize=5.4 K 2023-11-02 21:57:30,970 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/a7b2150c83034286b79a6a6f7583a63a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/a7b2150c83034286b79a6a6f7583a63a 2023-11-02 21:57:30,973 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/a7b2150c83034286b79a6a6f7583a63a, entries=2, sequenceid=9, filesize=5.1 K 2023-11-02 21:57:30,974 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8868577134076e1bd90135190764517a in 1313ms, sequenceid=9, compaction requested=false 2023-11-02 21:57:30,974 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:57:30,974 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:30,974 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:57:31,367 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/867891984d344930a09a4eef373b0f2a 2023-11-02 21:57:31,367 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/89624d66bcc04d2489b602e4f55b6a01 2023-11-02 21:57:31,372 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/339ac8297d294a61904a61da74d49aa3 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/339ac8297d294a61904a61da74d49aa3 2023-11-02 21:57:31,373 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/66b56024472849ad9fd0199b4b80b3c4 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/66b56024472849ad9fd0199b4b80b3c4 2023-11-02 21:57:31,376 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/339ac8297d294a61904a61da74d49aa3, entries=4, sequenceid=9, filesize=5.4 K 2023-11-02 21:57:31,377 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/867891984d344930a09a4eef373b0f2a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/867891984d344930a09a4eef373b0f2a 2023-11-02 21:57:31,377 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/66b56024472849ad9fd0199b4b80b3c4, entries=4, sequenceid=9, filesize=5.4 K 2023-11-02 21:57:31,378 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/89624d66bcc04d2489b602e4f55b6a01 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/89624d66bcc04d2489b602e4f55b6a01 2023-11-02 21:57:31,381 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/867891984d344930a09a4eef373b0f2a, entries=2, sequenceid=9, filesize=5.1 K 2023-11-02 21:57:31,381 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/89624d66bcc04d2489b602e4f55b6a01, entries=2, sequenceid=9, filesize=5.1 K 2023-11-02 21:57:31,381 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 173673ee4b2ff5cef47c017ea56e3191 in 1720ms, sequenceid=9, compaction requested=false 2023-11-02 21:57:31,382 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:57:31,382 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:31,382 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:57:31,382 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d124ffa7fff84dce506beb288e8a5590 in 1721ms, sequenceid=9, compaction requested=false 2023-11-02 21:57:31,382 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:57:31,382 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:31,382 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:57:31,382 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:57:31,382 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,382 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-02 21:57:31,382 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-02 21:57:31,435 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:31,435 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:31,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:31,436 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:31,436 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:31,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:31,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:31,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:31,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:31,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-02 21:57:31,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@93d7844[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:31,439 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-02 21:57:31,439 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:31,446 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:31,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:31,446 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-02 21:57:31,446 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-02 21:57:31,446 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:31,446 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,446 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:31,456 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-02 21:57:31,456 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:31,456 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-02 21:57:31,456 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:31,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:31,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:31,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:31,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:31,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:31,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:31,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:31,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-02 21:57:31,465 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-02 21:57:31,465 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:31,465 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:31,465 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-02 21:57:31,465 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:31,477 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:31,477 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:31,478 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:31,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:31,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:31,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:31,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:31,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:31,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:31,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:31,479 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:31,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:31,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:31,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:31,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:31,482 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:31,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:31,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,497 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,497 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:31,497 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:31,497 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:31,497 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:31,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:31,497 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:31,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-02 21:57:31,497 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,497 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:31,497 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:31,498 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:31,497 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-02 21:57:31,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:31,498 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:31,498 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:31,498 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:31,598 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:31,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:31,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:31,603 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:31,603 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:31,608 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:31,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:31,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-02 21:57:31,610 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-02 21:57:31,611 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:31,611 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-02 21:57:31,611 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-02 21:57:31,611 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:31,611 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:31,623 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,623 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:31,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:31,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:31,624 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:31,624 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:31,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:31,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:31,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:31,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:31,624 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-02 21:57:31,625 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-02 21:57:31,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-02 21:57:31,625 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-02 21:57:31,625 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:31,625 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-02 21:57:31,625 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:31,625 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:31,625 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. started... 2023-11-02 21:57:31,625 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:31,625 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. started... 2023-11-02 21:57:31,625 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. started... 2023-11-02 21:57:31,625 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:57:31,625 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:31,625 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d124ffa7fff84dce506beb288e8a5590 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-02 21:57:31,625 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 173673ee4b2ff5cef47c017ea56e3191 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-02 21:57:31,625 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8868577134076e1bd90135190764517a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-02 21:57:32,050 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311023788ed12a52d47549499dc965dc8f767 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311023788ed12a52d47549499dc965dc8f767 2023-11-02 21:57:32,051 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110286aea977124d40e680f3059cddf539a1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023110286aea977124d40e680f3059cddf539a1 2023-11-02 21:57:32,053 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110299a3b10584a743d4b5c2dc11fe73d991 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023110299a3b10584a743d4b5c2dc11fe73d991 2023-11-02 21:57:32,055 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/8d89ac441dbd41398775f8eaa2ccd15c 2023-11-02 21:57:32,313 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:57:32,458 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/94e333694236442aa500be547031214b 2023-11-02 21:57:32,459 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/f2f8d9aacc2b4ee98adaf20420935871 2023-11-02 21:57:32,471 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102350b9d054f6f46d38d36e9e3391c6e05 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231102350b9d054f6f46d38d36e9e3391c6e05 2023-11-02 21:57:32,478 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/5bc2511c4feb4994bad4716200727cd6 2023-11-02 21:57:32,481 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102e106a9ab00ec43f68802848387d60655 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231102e106a9ab00ec43f68802848387d60655 2023-11-02 21:57:32,481 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/8d89ac441dbd41398775f8eaa2ccd15c as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/8d89ac441dbd41398775f8eaa2ccd15c 2023-11-02 21:57:32,485 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/8d89ac441dbd41398775f8eaa2ccd15c, entries=4, sequenceid=13, filesize=5.4 K 2023-11-02 21:57:32,486 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/5bc2511c4feb4994bad4716200727cd6 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/5bc2511c4feb4994bad4716200727cd6 2023-11-02 21:57:32,490 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/5bc2511c4feb4994bad4716200727cd6, entries=2, sequenceid=13, filesize=5.1 K 2023-11-02 21:57:32,491 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d124ffa7fff84dce506beb288e8a5590 in 866ms, sequenceid=13, compaction requested=true 2023-11-02 21:57:32,491 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:57:32,491 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:32,491 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:57:32,886 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311023f2844d2f74f49e1b5d119db04947fd6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311023f2844d2f74f49e1b5d119db04947fd6 2023-11-02 21:57:32,886 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/b55be3cba02b46fd91c921bf08e1ea6a 2023-11-02 21:57:32,893 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/94e333694236442aa500be547031214b as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/94e333694236442aa500be547031214b 2023-11-02 21:57:32,898 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/94e333694236442aa500be547031214b, entries=4, sequenceid=13, filesize=5.4 K 2023-11-02 21:57:32,899 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/b55be3cba02b46fd91c921bf08e1ea6a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/b55be3cba02b46fd91c921bf08e1ea6a 2023-11-02 21:57:32,904 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/b55be3cba02b46fd91c921bf08e1ea6a, entries=2, sequenceid=13, filesize=5.1 K 2023-11-02 21:57:32,905 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8868577134076e1bd90135190764517a in 1280ms, sequenceid=13, compaction requested=true 2023-11-02 21:57:32,905 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:57:32,905 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:32,905 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:57:33,293 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/aaf6a71c3a2141a5a8d170f1c638f2b4 2023-11-02 21:57:33,298 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/f2f8d9aacc2b4ee98adaf20420935871 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/f2f8d9aacc2b4ee98adaf20420935871 2023-11-02 21:57:33,302 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/f2f8d9aacc2b4ee98adaf20420935871, entries=4, sequenceid=13, filesize=5.4 K 2023-11-02 21:57:33,303 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/aaf6a71c3a2141a5a8d170f1c638f2b4 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/aaf6a71c3a2141a5a8d170f1c638f2b4 2023-11-02 21:57:33,307 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/aaf6a71c3a2141a5a8d170f1c638f2b4, entries=2, sequenceid=13, filesize=5.1 K 2023-11-02 21:57:33,307 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 173673ee4b2ff5cef47c017ea56e3191 in 1682ms, sequenceid=13, compaction requested=true 2023-11-02 21:57:33,307 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:57:33,307 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:33,307 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:57:33,307 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:57:33,307 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,308 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-02 21:57:33,308 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-02 21:57:33,361 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,361 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:33,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:33,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:33,362 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:33,362 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:33,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:33,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:33,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-02 21:57:33,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b66e450[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:33,368 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-02 21:57:33,368 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:33,381 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:33,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:33,382 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-02 21:57:33,382 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-02 21:57:33,382 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:33,382 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,382 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:33,426 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-02 21:57:33,426 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:33,426 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,426 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-02 21:57:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:33,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:33,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:33,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-02 21:57:33,437 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-02 21:57:33,437 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:33,438 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:33,438 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-02 21:57:33,438 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:33,456 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:33,456 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:33,457 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:33,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:33,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:33,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:33,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:33,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:33,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:33,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:33,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:33,458 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:33,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:33,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:33,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:33,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,462 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:33,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:33,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,477 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:33,477 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,477 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:33,477 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:33,477 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:33,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:33,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:33,477 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:33,477 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-02 21:57:33,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:33,477 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,478 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:33,478 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:33,478 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:33,478 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:33,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:33,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:33,478 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:33,578 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:33,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:33,581 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:33,582 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:33,582 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:57:33,587 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:33,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:33,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-02 21:57:33,589 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-02 21:57:33,589 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:33,589 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-02 21:57:33,589 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-02 21:57:33,590 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:33,590 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:33,602 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:33,602 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:33,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:33,603 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:33,603 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:33,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:33,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:33,604 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-02 21:57:33,604 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-02 21:57:33,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-02 21:57:33,604 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-02 21:57:33,604 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:33,604 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-02 21:57:33,604 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:33,604 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. started... 2023-11-02 21:57:33,604 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:33,604 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:33,604 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8868577134076e1bd90135190764517a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-02 21:57:33,604 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:57:33,604 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:33,604 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. started... 2023-11-02 21:57:33,604 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. started... 2023-11-02 21:57:33,605 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d124ffa7fff84dce506beb288e8a5590 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-02 21:57:33,605 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 173673ee4b2ff5cef47c017ea56e3191 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-02 21:57:34,036 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110204cfe988ed8c425e9331cee27ce66d93 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023110204cfe988ed8c425e9331cee27ce66d93 2023-11-02 21:57:34,036 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311022ad9e91dbe764f758016f6e809fd10d3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311022ad9e91dbe764f758016f6e809fd10d3 2023-11-02 21:57:34,036 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311027bf3e3b44d7346e48700d93d4121896d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311027bf3e3b44d7346e48700d93d4121896d 2023-11-02 21:57:34,447 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/3c556346ec2c425e85c6d918cc143c32 2023-11-02 21:57:34,447 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/0cf46f8f802944e494103464e385d9ad 2023-11-02 21:57:34,447 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/06628438bb7640a1a9e17fce8b244638 2023-11-02 21:57:34,466 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102e3a8eeddba5547a69d7d0bcf1fbe252c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231102e3a8eeddba5547a69d7d0bcf1fbe252c 2023-11-02 21:57:34,866 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102667e4732099d4ed582aeb115e80aed84 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231102667e4732099d4ed582aeb115e80aed84 2023-11-02 21:57:34,866 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102a6e951c976f54916bcd99cfb6d7d8fbb to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231102a6e951c976f54916bcd99cfb6d7d8fbb 2023-11-02 21:57:34,871 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/e737e74d949841238bbfd3d6b1da044b 2023-11-02 21:57:34,875 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/06628438bb7640a1a9e17fce8b244638 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/06628438bb7640a1a9e17fce8b244638 2023-11-02 21:57:34,879 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/06628438bb7640a1a9e17fce8b244638, entries=4, sequenceid=17, filesize=5.4 K 2023-11-02 21:57:34,880 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/e737e74d949841238bbfd3d6b1da044b as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/e737e74d949841238bbfd3d6b1da044b 2023-11-02 21:57:34,884 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/e737e74d949841238bbfd3d6b1da044b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-02 21:57:34,885 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8868577134076e1bd90135190764517a in 1281ms, sequenceid=17, compaction requested=true 2023-11-02 21:57:34,885 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:57:34,885 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:34,885 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:57:35,270 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/02543c6bdfb943968fc809b9f9ba65ea 2023-11-02 21:57:35,271 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/6a1a0cbccb4b4d6cb0aee868687cf1f3 2023-11-02 21:57:35,274 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/0cf46f8f802944e494103464e385d9ad as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0cf46f8f802944e494103464e385d9ad 2023-11-02 21:57:35,274 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/3c556346ec2c425e85c6d918cc143c32 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/3c556346ec2c425e85c6d918cc143c32 2023-11-02 21:57:35,278 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0cf46f8f802944e494103464e385d9ad, entries=4, sequenceid=17, filesize=5.4 K 2023-11-02 21:57:35,279 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/02543c6bdfb943968fc809b9f9ba65ea as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/02543c6bdfb943968fc809b9f9ba65ea 2023-11-02 21:57:35,280 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/3c556346ec2c425e85c6d918cc143c32, entries=4, sequenceid=17, filesize=5.4 K 2023-11-02 21:57:35,281 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/6a1a0cbccb4b4d6cb0aee868687cf1f3 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/6a1a0cbccb4b4d6cb0aee868687cf1f3 2023-11-02 21:57:35,292 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/02543c6bdfb943968fc809b9f9ba65ea, entries=2, sequenceid=17, filesize=5.1 K 2023-11-02 21:57:35,292 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/6a1a0cbccb4b4d6cb0aee868687cf1f3, entries=2, sequenceid=17, filesize=5.1 K 2023-11-02 21:57:35,293 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 173673ee4b2ff5cef47c017ea56e3191 in 1688ms, sequenceid=17, compaction requested=true 2023-11-02 21:57:35,293 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:57:35,293 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d124ffa7fff84dce506beb288e8a5590 in 1688ms, sequenceid=17, compaction requested=true 2023-11-02 21:57:35,293 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:35,293 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:57:35,294 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:57:35,294 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:35,294 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:57:35,294 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:57:35,294 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,294 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-02 21:57:35,294 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-02 21:57:35,298 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:35,298 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:35,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:35,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:35,298 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:35,299 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:35,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:35,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:35,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:35,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-02 21:57:35,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@154195da[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:35,300 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-02 21:57:35,300 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:35,308 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:35,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:35,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:35,309 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-02 21:57:35,309 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-02 21:57:35,309 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,309 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:35,309 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:35,319 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-02 21:57:35,319 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,319 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:35,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:35,319 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-02 21:57:35,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:35,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:35,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:35,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:35,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:35,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:35,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:35,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-02 21:57:35,322 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-02 21:57:35,322 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:35,322 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:35,322 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-02 21:57:35,322 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:35,330 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:35,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:35,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:35,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:35,330 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:35,330 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:35,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:35,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:35,331 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:35,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:35,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,333 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,340 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:35,340 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:35,340 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,340 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:35,340 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:35,340 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-02 21:57:35,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:35,340 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-02 21:57:35,341 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:35,340 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:35,340 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:35,341 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:35,341 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:35,341 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:35,341 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:35,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:35,441 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:35,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:35,464 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:35,474 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:35,485 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:35,487 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:35,531 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:35,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:35,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-02 21:57:35,533 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-02 21:57:35,533 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:35,533 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-02 21:57:35,533 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-02 21:57:35,533 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:35,533 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:35,540 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:35,540 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:35,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:35,541 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:35,541 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:35,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:35,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:35,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:35,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:35,541 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-02 21:57:35,543 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-02 21:57:35,543 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-02 21:57:35,543 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-02 21:57:35,543 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:35,543 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-02 21:57:35,543 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:35,543 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. started... 2023-11-02 21:57:35,543 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8868577134076e1bd90135190764517a 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-02 21:57:35,543 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:35,543 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. started... 2023-11-02 21:57:35,543 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:57:35,543 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:35,543 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:35,543 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. started... 2023-11-02 21:57:35,544 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing d124ffa7fff84dce506beb288e8a5590 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-02 21:57:35,544 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 173673ee4b2ff5cef47c017ea56e3191 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-02 21:57:36,369 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/73660ace24eb49479152bcbaab469139 2023-11-02 21:57:36,375 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73660ace24eb49479152bcbaab469139 2023-11-02 21:57:36,377 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/2b0c4523fa6b43cf83adc56bb576b224 2023-11-02 21:57:36,377 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/27549c5e066146f4bdcd8919470c6bb3 2023-11-02 21:57:36,383 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27549c5e066146f4bdcd8919470c6bb3 2023-11-02 21:57:36,385 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b0c4523fa6b43cf83adc56bb576b224 2023-11-02 21:57:37,191 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/61516781c9c84856bd27e37ce32a8a58 2023-11-02 21:57:37,196 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61516781c9c84856bd27e37ce32a8a58 2023-11-02 21:57:37,196 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/73660ace24eb49479152bcbaab469139 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/73660ace24eb49479152bcbaab469139 2023-11-02 21:57:37,199 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/422bc4decda44c4582859519c0230a23 2023-11-02 21:57:37,199 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/84235d91c5f64e7bb8199466be162144 2023-11-02 21:57:37,202 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 422bc4decda44c4582859519c0230a23 2023-11-02 21:57:37,202 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73660ace24eb49479152bcbaab469139 2023-11-02 21:57:37,202 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84235d91c5f64e7bb8199466be162144 2023-11-02 21:57:37,202 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/73660ace24eb49479152bcbaab469139, entries=3, sequenceid=23, filesize=5.0 K 2023-11-02 21:57:37,203 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/2b0c4523fa6b43cf83adc56bb576b224 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/2b0c4523fa6b43cf83adc56bb576b224 2023-11-02 21:57:37,203 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/27549c5e066146f4bdcd8919470c6bb3 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/27549c5e066146f4bdcd8919470c6bb3 2023-11-02 21:57:37,203 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/61516781c9c84856bd27e37ce32a8a58 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/61516781c9c84856bd27e37ce32a8a58 2023-11-02 21:57:37,208 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61516781c9c84856bd27e37ce32a8a58 2023-11-02 21:57:37,208 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27549c5e066146f4bdcd8919470c6bb3 2023-11-02 21:57:37,208 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/61516781c9c84856bd27e37ce32a8a58, entries=1, sequenceid=23, filesize=5.0 K 2023-11-02 21:57:37,208 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/27549c5e066146f4bdcd8919470c6bb3, entries=3, sequenceid=23, filesize=5.0 K 2023-11-02 21:57:37,208 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b0c4523fa6b43cf83adc56bb576b224 2023-11-02 21:57:37,208 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/2b0c4523fa6b43cf83adc56bb576b224, entries=3, sequenceid=23, filesize=5.0 K 2023-11-02 21:57:37,209 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8868577134076e1bd90135190764517a in 1666ms, sequenceid=23, compaction requested=true 2023-11-02 21:57:37,209 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/84235d91c5f64e7bb8199466be162144 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/84235d91c5f64e7bb8199466be162144 2023-11-02 21:57:37,209 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:57:37,209 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/422bc4decda44c4582859519c0230a23 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/422bc4decda44c4582859519c0230a23 2023-11-02 21:57:37,209 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:37,209 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:57:37,212 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 422bc4decda44c4582859519c0230a23 2023-11-02 21:57:37,212 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84235d91c5f64e7bb8199466be162144 2023-11-02 21:57:37,212 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/422bc4decda44c4582859519c0230a23, entries=1, sequenceid=23, filesize=5.0 K 2023-11-02 21:57:37,212 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/84235d91c5f64e7bb8199466be162144, entries=1, sequenceid=23, filesize=5.0 K 2023-11-02 21:57:37,212 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 173673ee4b2ff5cef47c017ea56e3191 in 1668ms, sequenceid=23, compaction requested=true 2023-11-02 21:57:37,212 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d124ffa7fff84dce506beb288e8a5590 in 1668ms, sequenceid=23, compaction requested=true 2023-11-02 21:57:37,212 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:57:37,212 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:57:37,212 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:37,213 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:37,213 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:57:37,213 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:57:37,213 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:57:37,213 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,213 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-02 21:57:37,213 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-02 21:57:37,262 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,262 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:37,263 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:37,263 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:37,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-02 21:57:37,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68676e4b[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:37,265 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-02 21:57:37,265 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:37,305 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:37,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:37,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:37,305 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-02 21:57:37,305 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-02 21:57:37,305 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:37,305 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,306 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:37,329 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-02 21:57:37,330 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,330 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:37,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:37,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:37,330 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-02 21:57:37,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:37,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:37,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:37,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:37,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:37,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:37,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-02 21:57:37,332 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-02 21:57:37,332 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:37,332 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:37,332 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-02 21:57:37,332 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:37,340 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:37,340 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:37,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:37,340 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:37,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:37,340 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:37,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:37,342 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:37,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-02 21:57:37,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,350 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,350 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:37,350 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:37,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:37,351 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-02 21:57:37,351 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:37,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-02 21:57:37,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:37,351 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:37,350 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-02 21:57:37,351 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:37,351 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:37,351 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:37,351 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:37,351 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:37,351 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-02 21:57:37,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:37,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:37,351 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-02 21:57:37,451 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:37,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:37,453 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:37,453 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 8868577134076e1bd90135190764517a/family1 is initiating major compaction (all files) 2023-11-02 21:57:37,453 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:37,453 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:37,454 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 8868577134076e1bd90135190764517a/family1 in ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:37,454 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/cf64bcff49bc4d86ab9d9d74ac401b48, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/fdc9d9b9cc9344e4825b718c7bc0f5e2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/94e333694236442aa500be547031214b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/06628438bb7640a1a9e17fce8b244638, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/73660ace24eb49479152bcbaab469139] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp, totalSize=26.6 K 2023-11-02 21:57:37,455 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting cf64bcff49bc4d86ab9d9d74ac401b48, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962247666 2023-11-02 21:57:37,455 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting fdc9d9b9cc9344e4825b718c7bc0f5e2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962249645 2023-11-02 21:57:37,456 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 94e333694236442aa500be547031214b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962251603 2023-11-02 21:57:37,457 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 06628438bb7640a1a9e17fce8b244638, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962253582 2023-11-02 21:57:37,458 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 73660ace24eb49479152bcbaab469139, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:57:37,475 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 8868577134076e1bd90135190764517a#family1#compaction#150 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:37,885 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110299d2e06a883c4d679a65107034c41fad_del 2023-11-02 21:57:37,885 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110299d2e06a883c4d679a65107034c41fad_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023110299d2e06a883c4d679a65107034c41fad_del 2023-11-02 21:57:38,710 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6e883681ef845c0be6bb0b353903653 2023-11-02 21:57:38,711 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family1/d6e883681ef845c0be6bb0b353903653 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/d6e883681ef845c0be6bb0b353903653 2023-11-02 21:57:38,718 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6e883681ef845c0be6bb0b353903653 2023-11-02 21:57:38,720 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8868577134076e1bd90135190764517a/family1 of 8868577134076e1bd90135190764517a into d6e883681ef845c0be6bb0b353903653(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:38,720 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:57:38,720 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:38,720 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 8868577134076e1bd90135190764517a/family2 is initiating major compaction (all files) 2023-11-02 21:57:38,720 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:38,720 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:38,721 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 8868577134076e1bd90135190764517a/family2 in ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:57:38,721 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/08c9f434b8a04f628d9b46222ba5dd70, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/a7b2150c83034286b79a6a6f7583a63a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/b55be3cba02b46fd91c921bf08e1ea6a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/e737e74d949841238bbfd3d6b1da044b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/61516781c9c84856bd27e37ce32a8a58] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp, totalSize=25.3 K 2023-11-02 21:57:38,721 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 08c9f434b8a04f628d9b46222ba5dd70, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962247666 2023-11-02 21:57:38,722 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting a7b2150c83034286b79a6a6f7583a63a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962249645 2023-11-02 21:57:38,722 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting b55be3cba02b46fd91c921bf08e1ea6a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962251603 2023-11-02 21:57:38,723 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting e737e74d949841238bbfd3d6b1da044b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962253582 2023-11-02 21:57:38,723 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 61516781c9c84856bd27e37ce32a8a58, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:57:38,730 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 8868577134076e1bd90135190764517a#family2#compaction#151 average throughput is 1.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:38,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/cf64bcff49bc4d86ab9d9d74ac401b48, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/fdc9d9b9cc9344e4825b718c7bc0f5e2, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/94e333694236442aa500be547031214b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/06628438bb7640a1a9e17fce8b244638, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/73660ace24eb49479152bcbaab469139] to archive 2023-11-02 21:57:38,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:38,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/cf64bcff49bc4d86ab9d9d74ac401b48 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/cf64bcff49bc4d86ab9d9d74ac401b48 2023-11-02 21:57:38,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/fdc9d9b9cc9344e4825b718c7bc0f5e2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/fdc9d9b9cc9344e4825b718c7bc0f5e2 2023-11-02 21:57:38,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/94e333694236442aa500be547031214b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/94e333694236442aa500be547031214b 2023-11-02 21:57:38,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/06628438bb7640a1a9e17fce8b244638 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/06628438bb7640a1a9e17fce8b244638 2023-11-02 21:57:38,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/73660ace24eb49479152bcbaab469139 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/73660ace24eb49479152bcbaab469139 2023-11-02 21:57:39,140 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231102b3a36598e8fa4f7286649bf80023c9ad_del 2023-11-02 21:57:39,140 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102b3a36598e8fa4f7286649bf80023c9ad_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231102b3a36598e8fa4f7286649bf80023c9ad_del 2023-11-02 21:57:39,967 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bd8df861ed747a296ca30b05d522a9c 2023-11-02 21:57:39,967 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/.tmp/family2/9bd8df861ed747a296ca30b05d522a9c as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/9bd8df861ed747a296ca30b05d522a9c 2023-11-02 21:57:39,972 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bd8df861ed747a296ca30b05d522a9c 2023-11-02 21:57:39,972 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8868577134076e1bd90135190764517a/family2 of 8868577134076e1bd90135190764517a into 9bd8df861ed747a296ca30b05d522a9c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:39,973 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:57:39,973 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:39,973 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 173673ee4b2ff5cef47c017ea56e3191/family1 is initiating major compaction (all files) 2023-11-02 21:57:39,973 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:39,973 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:39,973 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 173673ee4b2ff5cef47c017ea56e3191/family1 in ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:39,973 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/844c18254a554491b436b5bc17f1fe5d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/339ac8297d294a61904a61da74d49aa3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/f2f8d9aacc2b4ee98adaf20420935871, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/3c556346ec2c425e85c6d918cc143c32, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/2b0c4523fa6b43cf83adc56bb576b224] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp, totalSize=26.6 K 2023-11-02 21:57:39,974 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 844c18254a554491b436b5bc17f1fe5d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962247664 2023-11-02 21:57:39,974 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 339ac8297d294a61904a61da74d49aa3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962249644 2023-11-02 21:57:39,974 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting f2f8d9aacc2b4ee98adaf20420935871, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962251602 2023-11-02 21:57:39,974 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 3c556346ec2c425e85c6d918cc143c32, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962253581 2023-11-02 21:57:39,975 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 2b0c4523fa6b43cf83adc56bb576b224, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:57:39,983 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 173673ee4b2ff5cef47c017ea56e3191#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:40,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/08c9f434b8a04f628d9b46222ba5dd70, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/a7b2150c83034286b79a6a6f7583a63a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/b55be3cba02b46fd91c921bf08e1ea6a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/e737e74d949841238bbfd3d6b1da044b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/61516781c9c84856bd27e37ce32a8a58] to archive 2023-11-02 21:57:40,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:40,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/08c9f434b8a04f628d9b46222ba5dd70 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/08c9f434b8a04f628d9b46222ba5dd70 2023-11-02 21:57:40,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/a7b2150c83034286b79a6a6f7583a63a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/a7b2150c83034286b79a6a6f7583a63a 2023-11-02 21:57:40,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/b55be3cba02b46fd91c921bf08e1ea6a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/b55be3cba02b46fd91c921bf08e1ea6a 2023-11-02 21:57:40,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/e737e74d949841238bbfd3d6b1da044b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/e737e74d949841238bbfd3d6b1da044b 2023-11-02 21:57:40,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/61516781c9c84856bd27e37ce32a8a58 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family2/61516781c9c84856bd27e37ce32a8a58 2023-11-02 21:57:40,392 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023110285027953652745a7815e0836830fb427_del 2023-11-02 21:57:40,392 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110285027953652745a7815e0836830fb427_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023110285027953652745a7815e0836830fb427_del 2023-11-02 21:57:41,205 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9a46ee61d5b4a16a131b15895af0845 2023-11-02 21:57:41,205 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family1/c9a46ee61d5b4a16a131b15895af0845 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/c9a46ee61d5b4a16a131b15895af0845 2023-11-02 21:57:41,208 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9a46ee61d5b4a16a131b15895af0845 2023-11-02 21:57:41,209 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 173673ee4b2ff5cef47c017ea56e3191/family1 of 173673ee4b2ff5cef47c017ea56e3191 into c9a46ee61d5b4a16a131b15895af0845(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:41,209 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:57:41,209 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:41,209 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 173673ee4b2ff5cef47c017ea56e3191/family2 is initiating major compaction (all files) 2023-11-02 21:57:41,209 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:41,209 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:41,210 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 173673ee4b2ff5cef47c017ea56e3191/family2 in ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:57:41,210 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/cc906c04aa6d427388763c6a3feb16cc, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/867891984d344930a09a4eef373b0f2a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/aaf6a71c3a2141a5a8d170f1c638f2b4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/6a1a0cbccb4b4d6cb0aee868687cf1f3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/422bc4decda44c4582859519c0230a23] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp, totalSize=25.3 K 2023-11-02 21:57:41,210 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting cc906c04aa6d427388763c6a3feb16cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962247664 2023-11-02 21:57:41,210 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 867891984d344930a09a4eef373b0f2a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962249644 2023-11-02 21:57:41,211 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting aaf6a71c3a2141a5a8d170f1c638f2b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962251602 2023-11-02 21:57:41,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/844c18254a554491b436b5bc17f1fe5d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/339ac8297d294a61904a61da74d49aa3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/f2f8d9aacc2b4ee98adaf20420935871, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/3c556346ec2c425e85c6d918cc143c32, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/2b0c4523fa6b43cf83adc56bb576b224] to archive 2023-11-02 21:57:41,211 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 6a1a0cbccb4b4d6cb0aee868687cf1f3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962253581 2023-11-02 21:57:41,212 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 422bc4decda44c4582859519c0230a23, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:57:41,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:41,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/844c18254a554491b436b5bc17f1fe5d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/844c18254a554491b436b5bc17f1fe5d 2023-11-02 21:57:41,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/339ac8297d294a61904a61da74d49aa3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/339ac8297d294a61904a61da74d49aa3 2023-11-02 21:57:41,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/f2f8d9aacc2b4ee98adaf20420935871 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/f2f8d9aacc2b4ee98adaf20420935871 2023-11-02 21:57:41,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/3c556346ec2c425e85c6d918cc143c32 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/3c556346ec2c425e85c6d918cc143c32 2023-11-02 21:57:41,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/2b0c4523fa6b43cf83adc56bb576b224 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/2b0c4523fa6b43cf83adc56bb576b224 2023-11-02 21:57:41,238 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 173673ee4b2ff5cef47c017ea56e3191#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:41,647 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311029cc7462e2eca442d839b138441933ac3_del 2023-11-02 21:57:41,648 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311029cc7462e2eca442d839b138441933ac3_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311029cc7462e2eca442d839b138441933ac3_del 2023-11-02 21:57:42,467 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51626667e6ac42f1ba3fc3c3ec310d8a 2023-11-02 21:57:42,469 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/.tmp/family2/51626667e6ac42f1ba3fc3c3ec310d8a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/51626667e6ac42f1ba3fc3c3ec310d8a 2023-11-02 21:57:42,474 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51626667e6ac42f1ba3fc3c3ec310d8a 2023-11-02 21:57:42,476 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 173673ee4b2ff5cef47c017ea56e3191/family2 of 173673ee4b2ff5cef47c017ea56e3191 into 51626667e6ac42f1ba3fc3c3ec310d8a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:42,476 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:57:42,476 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:42,476 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): d124ffa7fff84dce506beb288e8a5590/family1 is initiating major compaction (all files) 2023-11-02 21:57:42,476 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:42,476 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:42,477 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of d124ffa7fff84dce506beb288e8a5590/family1 in ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:42,477 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0fce0436ec3d4ef4a661849bb9e8aae6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/66b56024472849ad9fd0199b4b80b3c4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/8d89ac441dbd41398775f8eaa2ccd15c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0cf46f8f802944e494103464e385d9ad, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/27549c5e066146f4bdcd8919470c6bb3] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp, totalSize=26.6 K 2023-11-02 21:57:42,478 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 0fce0436ec3d4ef4a661849bb9e8aae6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962247665 2023-11-02 21:57:42,478 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 66b56024472849ad9fd0199b4b80b3c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962249645 2023-11-02 21:57:42,479 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 8d89ac441dbd41398775f8eaa2ccd15c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962251603 2023-11-02 21:57:42,479 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 0cf46f8f802944e494103464e385d9ad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962253582 2023-11-02 21:57:42,479 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 27549c5e066146f4bdcd8919470c6bb3, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:57:42,487 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): d124ffa7fff84dce506beb288e8a5590#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:42,498 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231102067932dc9afc4138a38075dfa824be03_del 2023-11-02 21:57:42,498 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102067932dc9afc4138a38075dfa824be03_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231102067932dc9afc4138a38075dfa824be03_del 2023-11-02 21:57:42,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/cc906c04aa6d427388763c6a3feb16cc, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/867891984d344930a09a4eef373b0f2a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/aaf6a71c3a2141a5a8d170f1c638f2b4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/6a1a0cbccb4b4d6cb0aee868687cf1f3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/422bc4decda44c4582859519c0230a23] to archive 2023-11-02 21:57:42,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:42,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/cc906c04aa6d427388763c6a3feb16cc to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/cc906c04aa6d427388763c6a3feb16cc 2023-11-02 21:57:42,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/867891984d344930a09a4eef373b0f2a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/867891984d344930a09a4eef373b0f2a 2023-11-02 21:57:42,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/aaf6a71c3a2141a5a8d170f1c638f2b4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/aaf6a71c3a2141a5a8d170f1c638f2b4 2023-11-02 21:57:42,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/6a1a0cbccb4b4d6cb0aee868687cf1f3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/6a1a0cbccb4b4d6cb0aee868687cf1f3 2023-11-02 21:57:42,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/422bc4decda44c4582859519c0230a23 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family2/422bc4decda44c4582859519c0230a23 2023-11-02 21:57:42,914 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69082a268ca2470890cc6384b4b764cd 2023-11-02 21:57:42,915 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family1/69082a268ca2470890cc6384b4b764cd as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/69082a268ca2470890cc6384b4b764cd 2023-11-02 21:57:42,920 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69082a268ca2470890cc6384b4b764cd 2023-11-02 21:57:42,921 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d124ffa7fff84dce506beb288e8a5590/family1 of d124ffa7fff84dce506beb288e8a5590 into 69082a268ca2470890cc6384b4b764cd(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:57:42,921 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:57:42,921 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:57:42,921 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): d124ffa7fff84dce506beb288e8a5590/family2 is initiating major compaction (all files) 2023-11-02 21:57:42,921 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:57:42,921 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:57:42,922 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of d124ffa7fff84dce506beb288e8a5590/family2 in ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:57:42,922 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/f9d48beb98cd44859df15daa24cf79a5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/89624d66bcc04d2489b602e4f55b6a01, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/5bc2511c4feb4994bad4716200727cd6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/02543c6bdfb943968fc809b9f9ba65ea, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/84235d91c5f64e7bb8199466be162144] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp, totalSize=25.3 K 2023-11-02 21:57:42,922 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting f9d48beb98cd44859df15daa24cf79a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962247665 2023-11-02 21:57:42,923 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 89624d66bcc04d2489b602e4f55b6a01, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962249645 2023-11-02 21:57:42,923 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 5bc2511c4feb4994bad4716200727cd6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962251603 2023-11-02 21:57:42,923 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 02543c6bdfb943968fc809b9f9ba65ea, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962253582 2023-11-02 21:57:42,924 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 84235d91c5f64e7bb8199466be162144, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:57:42,932 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): d124ffa7fff84dce506beb288e8a5590#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:57:43,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0fce0436ec3d4ef4a661849bb9e8aae6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/66b56024472849ad9fd0199b4b80b3c4, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/8d89ac441dbd41398775f8eaa2ccd15c, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0cf46f8f802944e494103464e385d9ad, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/27549c5e066146f4bdcd8919470c6bb3] to archive 2023-11-02 21:57:43,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:43,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0fce0436ec3d4ef4a661849bb9e8aae6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0fce0436ec3d4ef4a661849bb9e8aae6 2023-11-02 21:57:43,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/66b56024472849ad9fd0199b4b80b3c4 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/66b56024472849ad9fd0199b4b80b3c4 2023-11-02 21:57:43,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/8d89ac441dbd41398775f8eaa2ccd15c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/8d89ac441dbd41398775f8eaa2ccd15c 2023-11-02 21:57:43,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0cf46f8f802944e494103464e385d9ad to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/0cf46f8f802944e494103464e385d9ad 2023-11-02 21:57:43,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/27549c5e066146f4bdcd8919470c6bb3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/27549c5e066146f4bdcd8919470c6bb3 2023-11-02 21:57:43,341 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311024bbf25a2b71f497ab2f330586ef353fd_del 2023-11-02 21:57:43,341 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311024bbf25a2b71f497ab2f330586ef353fd_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311024bbf25a2b71f497ab2f330586ef353fd_del 2023-11-02 21:57:44,156 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec465a7aa0e444ad81e7fa8de408db86 2023-11-02 21:57:44,157 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/.tmp/family2/ec465a7aa0e444ad81e7fa8de408db86 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/ec465a7aa0e444ad81e7fa8de408db86 2023-11-02 21:57:44,162 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec465a7aa0e444ad81e7fa8de408db86 2023-11-02 21:57:44,163 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d124ffa7fff84dce506beb288e8a5590/family2 of d124ffa7fff84dce506beb288e8a5590 into ec465a7aa0e444ad81e7fa8de408db86(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:57:44,163 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:57:44,168 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:44,172 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:44,175 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:44,176 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:44,186 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-02 21:57:44,198 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-02 21:57:44,201 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023110285027953652745a7815e0836830fb427_del 2023-11-02 21:57:44,203 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231102067932dc9afc4138a38075dfa824be03_del 2023-11-02 21:57:44,206 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110299d2e06a883c4d679a65107034c41fad_del 2023-11-02 21:57:44,206 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-02 21:57:44,207 DEBUG [Listener at localhost/34483] zookeeper.ReadOnlyZKClient(139): Connect 0x40a7e504 to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:57:44,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/f9d48beb98cd44859df15daa24cf79a5, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/89624d66bcc04d2489b602e4f55b6a01, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/5bc2511c4feb4994bad4716200727cd6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/02543c6bdfb943968fc809b9f9ba65ea, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/84235d91c5f64e7bb8199466be162144] to archive 2023-11-02 21:57:44,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:44,216 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/f9d48beb98cd44859df15daa24cf79a5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/f9d48beb98cd44859df15daa24cf79a5 2023-11-02 21:57:44,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/89624d66bcc04d2489b602e4f55b6a01 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/89624d66bcc04d2489b602e4f55b6a01 2023-11-02 21:57:44,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/5bc2511c4feb4994bad4716200727cd6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/5bc2511c4feb4994bad4716200727cd6 2023-11-02 21:57:44,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/02543c6bdfb943968fc809b9f9ba65ea to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/02543c6bdfb943968fc809b9f9ba65ea 2023-11-02 21:57:44,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/84235d91c5f64e7bb8199466be162144 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family2/84235d91c5f64e7bb8199466be162144 2023-11-02 21:57:44,245 DEBUG [Listener at localhost/34483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38984ade, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:57:44,247 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231102 for table='ns:testMinorCompaction' and column='family1' 2023-11-02 21:57:44,247 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231102 for table='ns:testMinorCompaction' and column='family1' 2023-11-02 21:57:44,247 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231102 for table='ns:testMinorCompaction' and column='family1' 2023-11-02 21:57:45,084 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110218695aeba8024e89adc497f31d55e3c5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023110218695aeba8024e89adc497f31d55e3c5 2023-11-02 21:57:45,084 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102ea7048c1b1da409f8b97a69e194cb648 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231102ea7048c1b1da409f8b97a69e194cb648 2023-11-02 21:57:45,084 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102f608cd3cbff448ada623639e16a1c298 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231102f608cd3cbff448ada623639e16a1c298 2023-11-02 21:57:45,085 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231102 table='ns:testMinorCompaction' column='family1' 2023-11-02 21:57:45,085 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231102 table='ns:testMinorCompaction' column='family1' 2023-11-02 21:57:45,085 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231102 table='ns:testMinorCompaction' column='family1' 2023-11-02 21:57:45,099 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:57:45,106 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:50644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:57:45,111 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:57:45,114 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:55098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:57:45,127 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231102/family1/7b67839624b248c693f782a129f293ce first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-02 21:57:45,128 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231102/family1/5ca2d652f4f54c10b9b6e9c5661946cc first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-02 21:57:45,128 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231102/family1/7b67839624b248c693f782a129f293ce}] 2023-11-02 21:57:45,128 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231102/family1/7961a52297b8480daad6aaacab68df0a first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-02 21:57:45,128 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231102/family1/5ca2d652f4f54c10b9b6e9c5661946cc}] 2023-11-02 21:57:45,129 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231102/family1/7961a52297b8480daad6aaacab68df0a}] 2023-11-02 21:57:45,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231102/family1/7b67839624b248c693f782a129f293ce for inclusion in 173673ee4b2ff5cef47c017ea56e3191/family1 2023-11-02 21:57:45,147 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231102/family1/7961a52297b8480daad6aaacab68df0a for inclusion in d124ffa7fff84dce506beb288e8a5590/family1 2023-11-02 21:57:45,147 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231102/family1/5ca2d652f4f54c10b9b6e9c5661946cc for inclusion in 8868577134076e1bd90135190764517a/family1 2023-11-02 21:57:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-02 21:57:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-02 21:57:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-02 21:57:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last=1 2023-11-02 21:57:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33583] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-02 21:57:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-02 21:57:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:57:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:57:45,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:57:45,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231102/family1/7961a52297b8480daad6aaacab68df0a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__u0mrkl462csthegqdur036qpm5frtvp8t7qid7oqvhd666eodh8etkvj7vd55hhr/family1/7961a52297b8480daad6aaacab68df0a 2023-11-02 21:57:45,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231102/family1/7b67839624b248c693f782a129f293ce to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__evh8vpfbgikdcegdgqkf8t4kctr44hlr885rn95m76f6hmkqeoq1dru4obams5j9/family1/7b67839624b248c693f782a129f293ce 2023-11-02 21:57:45,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231102/family1/5ca2d652f4f54c10b9b6e9c5661946cc to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__6nedv2helgepa3e36puv0dn4germ0ce7fjuuv4j36ooqr2rkc80md69m6rvvoh7n/family1/5ca2d652f4f54c10b9b6e9c5661946cc 2023-11-02 21:57:45,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__6nedv2helgepa3e36puv0dn4germ0ce7fjuuv4j36ooqr2rkc80md69m6rvvoh7n/family1/5ca2d652f4f54c10b9b6e9c5661946cc as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/46a3cd0b753946ea908aa85873807983_SeqId_28_ 2023-11-02 21:57:45,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__evh8vpfbgikdcegdgqkf8t4kctr44hlr885rn95m76f6hmkqeoq1dru4obams5j9/family1/7b67839624b248c693f782a129f293ce as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/366abe4108a04d45b68471b29379c781_SeqId_28_ 2023-11-02 21:57:45,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__u0mrkl462csthegqdur036qpm5frtvp8t7qid7oqvhd666eodh8etkvj7vd55hhr/family1/7961a52297b8480daad6aaacab68df0a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/1bfa693cbaba4d8393b0298c37e1ee35_SeqId_28_ 2023-11-02 21:57:45,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__evh8vpfbgikdcegdgqkf8t4kctr44hlr885rn95m76f6hmkqeoq1dru4obams5j9/family1/7b67839624b248c693f782a129f293ce into 173673ee4b2ff5cef47c017ea56e3191/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/366abe4108a04d45b68471b29379c781_SeqId_28_ - updating store file list. 2023-11-02 21:57:45,153 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__6nedv2helgepa3e36puv0dn4germ0ce7fjuuv4j36ooqr2rkc80md69m6rvvoh7n/family1/5ca2d652f4f54c10b9b6e9c5661946cc into 8868577134076e1bd90135190764517a/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/46a3cd0b753946ea908aa85873807983_SeqId_28_ - updating store file list. 2023-11-02 21:57:45,153 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__u0mrkl462csthegqdur036qpm5frtvp8t7qid7oqvhd666eodh8etkvj7vd55hhr/family1/7961a52297b8480daad6aaacab68df0a into d124ffa7fff84dce506beb288e8a5590/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/1bfa693cbaba4d8393b0298c37e1ee35_SeqId_28_ - updating store file list. 2023-11-02 21:57:45,157 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/1bfa693cbaba4d8393b0298c37e1ee35_SeqId_28_ into d124ffa7fff84dce506beb288e8a5590/family1 2023-11-02 21:57:45,157 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/46a3cd0b753946ea908aa85873807983_SeqId_28_ into 8868577134076e1bd90135190764517a/family1 2023-11-02 21:57:45,157 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__u0mrkl462csthegqdur036qpm5frtvp8t7qid7oqvhd666eodh8etkvj7vd55hhr/family1/7961a52297b8480daad6aaacab68df0a into d124ffa7fff84dce506beb288e8a5590/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/family1/1bfa693cbaba4d8393b0298c37e1ee35_SeqId_28_) 2023-11-02 21:57:45,157 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__6nedv2helgepa3e36puv0dn4germ0ce7fjuuv4j36ooqr2rkc80md69m6rvvoh7n/family1/5ca2d652f4f54c10b9b6e9c5661946cc into 8868577134076e1bd90135190764517a/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/family1/46a3cd0b753946ea908aa85873807983_SeqId_28_) 2023-11-02 21:57:45,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/366abe4108a04d45b68471b29379c781_SeqId_28_ into 173673ee4b2ff5cef47c017ea56e3191/family1 2023-11-02 21:57:45,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__evh8vpfbgikdcegdgqkf8t4kctr44hlr885rn95m76f6hmkqeoq1dru4obams5j9/family1/7b67839624b248c693f782a129f293ce into 173673ee4b2ff5cef47c017ea56e3191/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/family1/366abe4108a04d45b68471b29379c781_SeqId_28_) 2023-11-02 21:57:45,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__6nedv2helgepa3e36puv0dn4germ0ce7fjuuv4j36ooqr2rkc80md69m6rvvoh7n/family1/5ca2d652f4f54c10b9b6e9c5661946cc 2023-11-02 21:57:45,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__u0mrkl462csthegqdur036qpm5frtvp8t7qid7oqvhd666eodh8etkvj7vd55hhr/family1/7961a52297b8480daad6aaacab68df0a 2023-11-02 21:57:45,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__ns_testMinorCompaction__evh8vpfbgikdcegdgqkf8t4kctr44hlr885rn95m76f6hmkqeoq1dru4obams5j9/family1/7b67839624b248c693f782a129f293ce 2023-11-02 21:57:45,161 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231102 table='ns:testMinorCompaction' column='family1' 2023-11-02 21:57:45,163 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:45,165 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231102 table='ns:testMinorCompaction' column='family1' 2023-11-02 21:57:45,165 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231102a84fe3db4cde4c41aa1b46cbe7baa0ac to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231102a84fe3db4cde4c41aa1b46cbe7baa0ac 2023-11-02 21:57:45,165 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-02 21:57:45,165 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231102' 2023-11-02 21:57:45,165 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:45,166 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231102 for table='ns:testMinorCompaction' and column='family1' 2023-11-02 21:57:45,166 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311020b05badc43f145c98e8a16021b9d8dd6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311020b05badc43f145c98e8a16021b9d8dd6 2023-11-02 21:57:45,167 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-02 21:57:45,167 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231102' 2023-11-02 21:57:45,167 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231102 for table='ns:testMinorCompaction' and column='family1' 2023-11-02 21:57:45,169 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231102 table='ns:testMinorCompaction' column='family1' 2023-11-02 21:57:45,169 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:45,171 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231102928edb7489e54da497f40f5e6e555e3b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231102928edb7489e54da497f40f5e6e555e3b 2023-11-02 21:57:45,171 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-02 21:57:45,171 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231102' 2023-11-02 21:57:45,171 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231102 for table='ns:testMinorCompaction' and column='family1' 2023-11-02 21:57:45,171 INFO [Listener at localhost/34483] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-02 21:57:45,173 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:45,176 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:45,179 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:57:45,179 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:57:45,194 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 286), OpenFileDescriptor=643 (was 791), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=128 (was 118) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=235 (was 292) 2023-11-02 21:57:45,205 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=643, MaxFileDescriptor=60000, SystemLoadAverage=128, ProcessCount=176, AvailableMemoryMB=234 2023-11-02 21:57:45,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-02 21:57:45,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:45,209 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:57:45,209 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-02 21:57:45,210 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:57:45,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-02 21:57:45,211 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84 2023-11-02 21:57:45,211 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84 empty. 2023-11-02 21:57:45,211 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84 2023-11-02 21:57:45,211 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-02 21:57:45,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-02 21:57:45,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-02 21:57:45,618 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-02 21:57:45,619 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 164bf322b8449fbcab3e8d323d1a1b84, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:57:45,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-02 21:57:46,024 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:46,024 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 164bf322b8449fbcab3e8d323d1a1b84, disabling compactions & flushes 2023-11-02 21:57:46,024 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:46,024 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:46,024 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. after waiting 0 ms 2023-11-02 21:57:46,024 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:46,025 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:46,025 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:46,028 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:57:46,030 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698962266029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962266029"}]},"ts":"1698962266029"} 2023-11-02 21:57:46,032 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-02 21:57:46,033 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:57:46,033 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962266033"}]},"ts":"1698962266033"} 2023-11-02 21:57:46,034 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-02 21:57:46,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=164bf322b8449fbcab3e8d323d1a1b84, ASSIGN}] 2023-11-02 21:57:46,057 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=164bf322b8449fbcab3e8d323d1a1b84, ASSIGN 2023-11-02 21:57:46,058 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=164bf322b8449fbcab3e8d323d1a1b84, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:57:46,208 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=164bf322b8449fbcab3e8d323d1a1b84, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:46,209 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698962266208"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962266208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962266208"}]},"ts":"1698962266208"} 2023-11-02 21:57:46,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 164bf322b8449fbcab3e8d323d1a1b84, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:57:46,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-02 21:57:46,362 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:46,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:46,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 164bf322b8449fbcab3e8d323d1a1b84, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84.', STARTKEY => '', ENDKEY => ''} 2023-11-02 21:57:46,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 164bf322b8449fbcab3e8d323d1a1b84 2023-11-02 21:57:46,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:46,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 164bf322b8449fbcab3e8d323d1a1b84 2023-11-02 21:57:46,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 164bf322b8449fbcab3e8d323d1a1b84 2023-11-02 21:57:46,368 INFO [StoreOpener-164bf322b8449fbcab3e8d323d1a1b84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 164bf322b8449fbcab3e8d323d1a1b84 2023-11-02 21:57:46,370 DEBUG [StoreOpener-164bf322b8449fbcab3e8d323d1a1b84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1 2023-11-02 21:57:46,370 DEBUG [StoreOpener-164bf322b8449fbcab3e8d323d1a1b84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1 2023-11-02 21:57:46,371 INFO [StoreOpener-164bf322b8449fbcab3e8d323d1a1b84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 164bf322b8449fbcab3e8d323d1a1b84 columnFamilyName family1 2023-11-02 21:57:46,373 INFO [StoreOpener-164bf322b8449fbcab3e8d323d1a1b84-1] regionserver.HStore(310): Store=164bf322b8449fbcab3e8d323d1a1b84/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:57:46,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84 2023-11-02 21:57:46,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84 2023-11-02 21:57:46,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 164bf322b8449fbcab3e8d323d1a1b84 2023-11-02 21:57:46,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:57:46,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 164bf322b8449fbcab3e8d323d1a1b84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75289554, jitterRate=0.12190178036689758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-02 21:57:46,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:46,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84., pid=114, masterSystemTime=1698962266362 2023-11-02 21:57:46,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:46,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:46,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=164bf322b8449fbcab3e8d323d1a1b84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:46,385 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698962266385"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962266385"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962266385"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962266385"}]},"ts":"1698962266385"} 2023-11-02 21:57:46,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-02 21:57:46,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 164bf322b8449fbcab3e8d323d1a1b84, server=jenkins-hbase12.apache.org,33583,1698962105160 in 176 msec 2023-11-02 21:57:46,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-02 21:57:46,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=164bf322b8449fbcab3e8d323d1a1b84, ASSIGN in 333 msec 2023-11-02 21:57:46,389 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:57:46,390 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962266389"}]},"ts":"1698962266389"} 2023-11-02 21:57:46,390 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-02 21:57:46,509 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:57:46,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.3020 sec 2023-11-02 21:57:47,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-02 21:57:47,316 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-02 21:57:47,338 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:47,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:47,339 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:47,340 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:47,340 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:57:47,340 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:57:47,340 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:47,340 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:47,354 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:47,354 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:47,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:47,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:47,354 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:47,355 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:47,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:47,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:47,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:47,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:47,355 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:47,355 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:47,355 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:57:47,355 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:47,356 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:57:47,356 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:57:47,356 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:47,356 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:47,356 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. started... 2023-11-02 21:57:47,356 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 164bf322b8449fbcab3e8d323d1a1b84 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-02 21:57:47,777 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113081268abd8fab443ba993e929691d90bf to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113081268abd8fab443ba993e929691d90bf 2023-11-02 21:57:48,180 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/671e30e682f947088c1d525cd79ff6a9 2023-11-02 21:57:48,184 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/671e30e682f947088c1d525cd79ff6a9 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/671e30e682f947088c1d525cd79ff6a9 2023-11-02 21:57:48,186 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/671e30e682f947088c1d525cd79ff6a9, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-02 21:57:48,187 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 164bf322b8449fbcab3e8d323d1a1b84 in 831ms, sequenceid=5, compaction requested=false 2023-11-02 21:57:48,187 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:48,188 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:48,188 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:48,188 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:57:48,188 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:57:48,188 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,188 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:57:48,188 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:57:48,222 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,222 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:48,223 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,223 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:48,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:57:48,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a7ac45b[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:48,224 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:57:48,224 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,302 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,302 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:57:48,302 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:57:48,302 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:48,302 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,302 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:48,322 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:57:48,323 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:48,323 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:57:48,322 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:48,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:48,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:48,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:48,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:57:48,325 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:57:48,326 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:48,326 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:48,326 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,326 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:48,398 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,398 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:48,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,398 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:48,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:48,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:48,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:48,399 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:48,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,400 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,438 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:48,438 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,438 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:48,438 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:48,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:57:48,438 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,439 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:48,438 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:48,438 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:48,439 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:48,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:48,439 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,439 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,439 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,439 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,439 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:48,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:48,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:48,539 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:48,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:48,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:48,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:48,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,547 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:48,547 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:48,547 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:57:48,547 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:57:48,547 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,547 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,611 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:48,611 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:48,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:48,612 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,612 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:48,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,614 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:57:48,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:48,615 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:57:48,615 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:48,615 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:57:48,615 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:57:48,615 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:48,615 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:48,616 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. started... 2023-11-02 21:57:48,616 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 164bf322b8449fbcab3e8d323d1a1b84 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-02 21:57:49,030 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128cbbb3fa619d44080bf1014da41837b2d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128cbbb3fa619d44080bf1014da41837b2d 2023-11-02 21:57:49,436 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/10c068300718435ebca602824f25d554 2023-11-02 21:57:49,447 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/10c068300718435ebca602824f25d554 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/10c068300718435ebca602824f25d554 2023-11-02 21:57:49,453 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/10c068300718435ebca602824f25d554, entries=1, sequenceid=9, filesize=5.0 K 2023-11-02 21:57:49,454 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 164bf322b8449fbcab3e8d323d1a1b84 in 838ms, sequenceid=9, compaction requested=false 2023-11-02 21:57:49,454 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:49,454 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:49,454 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:57:49,454 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:57:49,454 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,454 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:57:49,455 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:57:49,500 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,500 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:49,501 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,501 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:49,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:57:49,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76c2f520[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:49,502 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:57:49,502 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,559 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,559 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:57:49,559 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:57:49,559 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:49,560 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,560 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:49,627 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:57:49,628 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,628 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:49,628 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:57:49,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:49,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:49,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:57:49,638 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:57:49,638 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:49,638 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:49,638 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,638 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:49,713 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,713 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:49,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,714 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:49,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:49,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:49,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:49,716 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,720 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:49,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,788 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,788 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:49,788 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,788 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:49,788 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:49,788 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,788 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,788 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,789 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,789 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:49,788 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:49,788 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:49,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:49,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:49,789 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:49,789 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:49,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:49,890 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:49,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:49,901 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:49,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:49,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,903 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:49,903 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:49,903 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:57:49,903 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:57:49,904 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,904 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,957 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:49,957 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:49,958 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:49,958 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:49,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,961 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,961 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:57:49,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:49,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:57:49,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:49,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:57:49,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:57:49,962 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:49,962 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:49,962 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. started... 2023-11-02 21:57:49,963 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 164bf322b8449fbcab3e8d323d1a1b84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:57:50,383 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120114809b54ccb64b0b81a6db203e9564b7 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120114809b54ccb64b0b81a6db203e9564b7 2023-11-02 21:57:50,391 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/f1799252e8684d0d89d10401e5e6243e 2023-11-02 21:57:50,395 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/f1799252e8684d0d89d10401e5e6243e as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f1799252e8684d0d89d10401e5e6243e 2023-11-02 21:57:50,399 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f1799252e8684d0d89d10401e5e6243e, entries=1, sequenceid=13, filesize=4.9 K 2023-11-02 21:57:50,400 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 164bf322b8449fbcab3e8d323d1a1b84 in 437ms, sequenceid=13, compaction requested=true 2023-11-02 21:57:50,400 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:50,400 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:50,400 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:57:50,400 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:57:50,400 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,400 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:57:50,400 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:57:50,451 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,451 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:50,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:50,452 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,452 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:50,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:50,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:57:50,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fb45167[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:50,456 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:57:50,456 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,475 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,475 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:57:50,475 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:57:50,475 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,475 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:50,475 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:50,485 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:57:50,485 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:50,486 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:57:50,485 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:50,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:57:50,488 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:57:50,488 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:50,488 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:50,488 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,488 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:50,501 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,501 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:50,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:50,501 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:50,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:50,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:50,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:50,502 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,503 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,557 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,558 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,558 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,557 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:50,558 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:50,558 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:50,558 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:50,558 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:50,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:50,558 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:50,559 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:50,558 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,559 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,559 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:50,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:50,560 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:50,660 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:50,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:50,668 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:50,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:50,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,671 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:50,671 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:50,671 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:57:50,671 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:57:50,672 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,672 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,686 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:50,686 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:50,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:50,686 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:50,686 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:50,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:50,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,688 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,688 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:57:50,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:50,689 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:57:50,689 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:50,689 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:57:50,689 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:57:50,689 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:50,689 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:50,689 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. started... 2023-11-02 21:57:50,689 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 164bf322b8449fbcab3e8d323d1a1b84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:57:51,104 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205068441a6d62945c3a76cf8bd0653d395 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205068441a6d62945c3a76cf8bd0653d395 2023-11-02 21:57:51,109 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/981a699617dc424fb46a8d0cb217e524 2023-11-02 21:57:51,112 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/981a699617dc424fb46a8d0cb217e524 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/981a699617dc424fb46a8d0cb217e524 2023-11-02 21:57:51,115 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/981a699617dc424fb46a8d0cb217e524, entries=1, sequenceid=17, filesize=4.9 K 2023-11-02 21:57:51,116 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 164bf322b8449fbcab3e8d323d1a1b84 in 427ms, sequenceid=17, compaction requested=true 2023-11-02 21:57:51,116 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:51,116 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:51,116 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:57:51,116 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:57:51,116 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,116 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:57:51,116 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:57:51,127 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,127 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:51,128 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:51,128 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:51,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:57:51,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cf26fec[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:51,129 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:57:51,129 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,149 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,149 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:57:51,149 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:57:51,149 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:51,149 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,149 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:51,170 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:57:51,170 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:51,170 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:57:51,170 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:51,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:51,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:51,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:51,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:57:51,177 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:57:51,177 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:51,177 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:51,178 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,178 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:51,191 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,191 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:51,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:51,191 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:51,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:51,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:51,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:51,193 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:51,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,195 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:51,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,212 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,212 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:51,212 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,212 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:51,212 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:51,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:57:51,212 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,213 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:51,212 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:51,212 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:51,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:51,213 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:51,213 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:51,213 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,213 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,213 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:51,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:51,313 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:51,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:51,317 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:51,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:51,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,319 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:51,319 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:51,319 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:57:51,319 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:57:51,319 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,319 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,338 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,338 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:51,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:51,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:51,339 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,339 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:51,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:51,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:57:51,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,339 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:57:51,339 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:51,339 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:57:51,340 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:57:51,340 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:51,340 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:51,340 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. started... 2023-11-02 21:57:51,340 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 164bf322b8449fbcab3e8d323d1a1b84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:57:51,757 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288fe8dbede1db4212b5f3b9df570b5b37 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512288fe8dbede1db4212b5f3b9df570b5b37 2023-11-02 21:57:51,770 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/b41afb6f567b4b32b8d1df55af073a55 2023-11-02 21:57:51,775 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/b41afb6f567b4b32b8d1df55af073a55 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/b41afb6f567b4b32b8d1df55af073a55 2023-11-02 21:57:51,781 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/b41afb6f567b4b32b8d1df55af073a55, entries=1, sequenceid=21, filesize=4.9 K 2023-11-02 21:57:51,782 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 164bf322b8449fbcab3e8d323d1a1b84 in 442ms, sequenceid=21, compaction requested=true 2023-11-02 21:57:51,782 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:51,782 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:51,782 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:57:51,782 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:57:51,782 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,782 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:57:51,782 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:57:51,791 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,791 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,791 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:51,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:51,791 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:51,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:51,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:51,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:51,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:57:51,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60f63c35[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:51,793 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:57:51,793 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,801 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,801 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:57:51,801 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:57:51,801 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:51,801 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,802 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:51,812 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:57:51,812 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,812 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:51,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:51,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:51,812 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:57:51,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:51,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:51,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:57:51,814 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:57:51,814 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:51,814 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:51,814 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,814 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:51,822 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,822 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,822 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:51,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:51,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:51,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,823 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:51,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:51,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:51,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:51,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,824 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:51,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,833 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:51,833 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:51,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:51,833 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:51,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,833 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:51,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:51,912 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:57:51,933 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:51,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:51,942 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:51,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:51,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,944 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:51,944 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:51,944 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:57:51,944 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:57:51,944 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,944 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,954 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:51,954 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:51,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:51,954 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:51,954 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:51,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:51,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,955 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,955 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:57:51,956 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:51,956 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:57:51,956 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:51,956 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:57:51,956 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:57:51,956 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:51,956 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:51,956 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. started... 2023-11-02 21:57:51,956 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 164bf322b8449fbcab3e8d323d1a1b84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:57:52,377 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ccd809d3468f4f47bef1162cab7e6db7 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ccd809d3468f4f47bef1162cab7e6db7 2023-11-02 21:57:52,782 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/f11bfc83bc98460bac9512cb9da3a1aa 2023-11-02 21:57:52,786 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/f11bfc83bc98460bac9512cb9da3a1aa as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f11bfc83bc98460bac9512cb9da3a1aa 2023-11-02 21:57:52,789 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f11bfc83bc98460bac9512cb9da3a1aa, entries=1, sequenceid=25, filesize=4.9 K 2023-11-02 21:57:52,790 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 164bf322b8449fbcab3e8d323d1a1b84 in 834ms, sequenceid=25, compaction requested=true 2023-11-02 21:57:52,790 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:52,790 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:52,790 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:57:52,790 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:57:52,790 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,790 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:57:52,790 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:57:52,812 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,812 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:52,812 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,812 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:52,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:52,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:57:52,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fcbefe[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:52,813 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:57:52,813 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,850 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,850 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:57:52,850 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:57:52,850 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:52,850 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,850 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:52,869 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:57:52,869 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:52,869 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,869 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:57:52,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:52,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:52,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:52,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:52,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:52,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:52,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:57:52,874 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:57:52,874 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:52,874 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:52,874 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,874 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:52,885 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,885 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:52,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,886 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:52,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:52,886 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,888 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,901 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:52,901 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:52,901 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:52,901 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:52,901 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:52,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:52,901 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:52,901 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,902 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,902 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:52,902 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:52,902 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:52,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:52,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:52,902 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,902 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:52,902 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,002 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:53,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:53,010 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:53,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:53,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,012 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:53,012 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:53,012 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:57:53,012 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:57:53,013 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,013 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,022 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:53,022 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:53,023 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,023 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,023 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,024 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:57:53,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,024 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:57:53,024 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:53,024 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:57:53,024 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:57:53,024 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:53,024 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:53,024 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. started... 2023-11-02 21:57:53,024 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 164bf322b8449fbcab3e8d323d1a1b84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:57:53,437 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010150afc5300dc1493a9e0aa8f0dbcd95bc to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010150afc5300dc1493a9e0aa8f0dbcd95bc 2023-11-02 21:57:53,841 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/7fb51eb3ad454758803b131781284773 2023-11-02 21:57:53,847 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/7fb51eb3ad454758803b131781284773 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/7fb51eb3ad454758803b131781284773 2023-11-02 21:57:53,851 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/7fb51eb3ad454758803b131781284773, entries=1, sequenceid=29, filesize=4.9 K 2023-11-02 21:57:53,852 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 164bf322b8449fbcab3e8d323d1a1b84 in 828ms, sequenceid=29, compaction requested=true 2023-11-02 21:57:53,852 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:53,852 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:53,852 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:57:53,852 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:57:53,852 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,852 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:57:53,852 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:57:53,927 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,927 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:53,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:53,928 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,928 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:53,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:53,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:53,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:53,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:57:53,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c8ef8cf[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:53,929 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:57:53,929 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,938 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,938 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:57:53,938 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:57:53,938 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:53,938 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,938 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:53,948 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:57:53,948 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,948 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:53,949 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:57:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:53,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:53,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:57:53,951 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:57:53,951 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:53,951 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:53,951 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,951 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:53,964 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,964 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:53,964 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:53,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:53,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:53,968 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:53,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,970 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:53,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,980 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,980 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,980 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,980 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:53,980 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,980 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,980 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:53,980 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:53,980 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:53,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:57:53,980 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:53,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:53,980 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:53,980 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:53,981 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:53,981 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:53,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:54,081 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:54,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:54,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:54,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:54,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,088 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:54,088 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:54,088 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:57:54,088 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:57:54,088 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,088 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,101 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:54,101 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:54,101 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,101 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,102 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,102 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:57:54,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,102 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:57:54,102 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:54,102 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:57:54,103 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:57:54,103 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:54,103 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:54,103 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. started... 2023-11-02 21:57:54,103 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 164bf322b8449fbcab3e8d323d1a1b84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:57:54,517 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a1e09621d9dd4c989b9ec47262b3f5a0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1e09621d9dd4c989b9ec47262b3f5a0 2023-11-02 21:57:54,523 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/bebf120ea4894f0a808588e3d9132617 2023-11-02 21:57:54,527 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/bebf120ea4894f0a808588e3d9132617 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/bebf120ea4894f0a808588e3d9132617 2023-11-02 21:57:54,530 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/bebf120ea4894f0a808588e3d9132617, entries=1, sequenceid=33, filesize=4.9 K 2023-11-02 21:57:54,531 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 164bf322b8449fbcab3e8d323d1a1b84 in 428ms, sequenceid=33, compaction requested=true 2023-11-02 21:57:54,531 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:54,531 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:54,531 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:57:54,531 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:57:54,531 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,531 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:57:54,531 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:57:54,580 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,580 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:54,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:54,580 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,580 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:54,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:57:54,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@632c63bd[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:54,582 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:57:54,582 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,591 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,591 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:57:54,591 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:57:54,591 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,591 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:54,591 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:54,601 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:57:54,601 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:54,601 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:57:54,601 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:54,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:54,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:57:54,604 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:57:54,604 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:54,604 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:54,604 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,604 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:54,617 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,617 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,617 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:54,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,618 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:54,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,619 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:54,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,662 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,662 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,662 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:54,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:54,662 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:54,662 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,662 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,662 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,662 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,662 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:54,662 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:54,668 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:54,668 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:54,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:54,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:54,763 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:54,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:54,767 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:54,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:54,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,769 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:54,769 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:54,769 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:57:54,769 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:57:54,769 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,769 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,790 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:54,790 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:54,791 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:54,791 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,792 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,792 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:57:54,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:54,792 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:57:54,792 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:54,792 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:57:54,792 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:57:54,792 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:54,792 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:54,792 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. started... 2023-11-02 21:57:54,793 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 164bf322b8449fbcab3e8d323d1a1b84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:57:55,209 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a1717b1da2434ae5b65e64e4ab18482c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907a1717b1da2434ae5b65e64e4ab18482c 2023-11-02 21:57:55,617 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/feb8dda289944018b3faf3aa70bdc1b1 2023-11-02 21:57:55,621 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/feb8dda289944018b3faf3aa70bdc1b1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/feb8dda289944018b3faf3aa70bdc1b1 2023-11-02 21:57:55,624 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/feb8dda289944018b3faf3aa70bdc1b1, entries=1, sequenceid=37, filesize=4.9 K 2023-11-02 21:57:55,624 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 164bf322b8449fbcab3e8d323d1a1b84 in 831ms, sequenceid=37, compaction requested=true 2023-11-02 21:57:55,625 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:55,625 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:55,625 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:57:55,625 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:57:55,625 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,625 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:57:55,625 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:57:55,738 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,738 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:55,738 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,738 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:55,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:57:55,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@326afc79[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:55,740 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:57:55,740 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,748 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,749 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:57:55,749 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:57:55,749 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,749 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:55,749 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:55,759 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,759 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:57:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:55,759 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:55,759 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:57:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:55,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:57:55,762 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:57:55,762 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:55,762 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:55,762 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,762 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:55,774 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,774 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:55,775 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:55,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,775 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:55,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:55,776 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,785 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,785 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,785 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,785 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:55,785 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:55,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:55,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:55,785 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:55,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:55,785 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,785 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:55,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,786 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,786 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:55,786 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:55,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:55,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-02 21:57:55,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:55,886 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:55,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:55,890 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:57:55,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-02 21:57:55,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,894 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:55,894 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:55,894 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-02 21:57:55,894 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-02 21:57:55,895 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,895 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,906 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,906 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:55,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:55,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:55,907 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:55,907 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:57:55,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:57:55,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,908 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,912 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-02 21:57:55,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:55,912 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-02 21:57:55,912 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:57:55,913 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-02 21:57:55,913 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-02 21:57:55,913 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:57:55,913 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:55,913 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. started... 2023-11-02 21:57:55,913 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 164bf322b8449fbcab3e8d323d1a1b84 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-02 21:57:55,946 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a76d6697ce4045159f644cf7bd5c2883 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120a76d6697ce4045159f644cf7bd5c2883 2023-11-02 21:57:56,358 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/460454f389c54e4595d603b8e16ad490 2023-11-02 21:57:56,363 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/460454f389c54e4595d603b8e16ad490 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/460454f389c54e4595d603b8e16ad490 2023-11-02 21:57:56,366 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/460454f389c54e4595d603b8e16ad490, entries=1, sequenceid=41, filesize=4.9 K 2023-11-02 21:57:56,367 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 164bf322b8449fbcab3e8d323d1a1b84 in 454ms, sequenceid=41, compaction requested=true 2023-11-02 21:57:56,367 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:56,367 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:56,367 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-02 21:57:56,367 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-02 21:57:56,367 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,367 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-02 21:57:56,367 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-02 21:57:56,380 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,380 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:56,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:56,381 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,381 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:57:56,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:56,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:56,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-02 21:57:56,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5605af84[Count = 0] remaining members to acquire global barrier 2023-11-02 21:57:56,383 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-02 21:57:56,383 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,390 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,391 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-02 21:57:56,391 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-02 21:57:56,391 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:57:56,391 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,391 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:57:56,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-02 21:57:56,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:56,401 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-02 21:57:56,401 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:56,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:56,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:56,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:57:56,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-02 21:57:56,404 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-02 21:57:56,404 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:57:56,404 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:57:56,404 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,404 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:57:56,417 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,417 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,417 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:57:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:57:56,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:57:56,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:56,417 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:57:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,418 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:57:56,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:57:56,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:57:56,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:57:56,427 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:57:56,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:57:56,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,427 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,427 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-02 21:57:56,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:57:56,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:57:56,428 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-02 21:57:56,428 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:57:56,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:57:56,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:57:56,528 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:57:56,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:57:56,545 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-02 21:57:56,547 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:57:56,548 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:57:56,550 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:57:56,550 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962876550 2023-11-02 21:57:56,554 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-02 21:57:56,555 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-02 21:57:56,555 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:57:56,557 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x540d5c3c to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:57:56,570 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5042feb0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:57:56,571 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:57:57,409 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010322ea13af5c4a4d4ba097fb1b09f4ad95 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010322ea13af5c4a4d4ba097fb1b09f4ad95 2023-11-02 21:57:57,410 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:57:57,423 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:57:57,425 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:40210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:57:57,433 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:57:57,434 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:49680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:57:57,445 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6f13e918fb1a4960a3eff99ea1188971 first=Optional[r5] last=Optional[r6] 2023-11-02 21:57:57,446 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6f13e918fb1a4960a3eff99ea1188971}] 2023-11-02 21:57:57,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6f13e918fb1a4960a3eff99ea1188971 for inclusion in 164bf322b8449fbcab3e8d323d1a1b84/family1 2023-11-02 21:57:57,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-02 21:57:57,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:57:57,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:57,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6f13e918fb1a4960a3eff99ea1188971 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l4cpad5ts8vk0rf2hu46ghotg3hntcshonia01hajm1iru23pcs1qcel1u8a2m23/family1/6f13e918fb1a4960a3eff99ea1188971 2023-11-02 21:57:57,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l4cpad5ts8vk0rf2hu46ghotg3hntcshonia01hajm1iru23pcs1qcel1u8a2m23/family1/6f13e918fb1a4960a3eff99ea1188971 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e3c47b7804774a33ad933096a589387f_SeqId_44_ 2023-11-02 21:57:57,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l4cpad5ts8vk0rf2hu46ghotg3hntcshonia01hajm1iru23pcs1qcel1u8a2m23/family1/6f13e918fb1a4960a3eff99ea1188971 into 164bf322b8449fbcab3e8d323d1a1b84/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e3c47b7804774a33ad933096a589387f_SeqId_44_ - updating store file list. 2023-11-02 21:57:57,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e3c47b7804774a33ad933096a589387f_SeqId_44_ into 164bf322b8449fbcab3e8d323d1a1b84/family1 2023-11-02 21:57:57,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l4cpad5ts8vk0rf2hu46ghotg3hntcshonia01hajm1iru23pcs1qcel1u8a2m23/family1/6f13e918fb1a4960a3eff99ea1188971 into 164bf322b8449fbcab3e8d323d1a1b84/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e3c47b7804774a33ad933096a589387f_SeqId_44_) 2023-11-02 21:57:57,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__l4cpad5ts8vk0rf2hu46ghotg3hntcshonia01hajm1iru23pcs1qcel1u8a2m23/family1/6f13e918fb1a4960a3eff99ea1188971 2023-11-02 21:57:57,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-02 21:57:57,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-02 21:57:57,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 164bf322b8449fbcab3e8d323d1a1b84/family1 is initiating minor compaction 2023-11-02 21:57:57,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@23a69762; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:57:57,490 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 164bf322b8449fbcab3e8d323d1a1b84/family1 in testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:57,490 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/10c068300718435ebca602824f25d554, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f1799252e8684d0d89d10401e5e6243e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/981a699617dc424fb46a8d0cb217e524, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/b41afb6f567b4b32b8d1df55af073a55, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f11bfc83bc98460bac9512cb9da3a1aa, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/7fb51eb3ad454758803b131781284773, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/bebf120ea4894f0a808588e3d9132617, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/feb8dda289944018b3faf3aa70bdc1b1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/460454f389c54e4595d603b8e16ad490, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e3c47b7804774a33ad933096a589387f_SeqId_44_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp, totalSize=49.7 K 2023-11-02 21:57:57,490 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 10c068300718435ebca602824f25d554, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-02 21:57:57,490 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting f1799252e8684d0d89d10401e5e6243e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-02 21:57:57,490 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 981a699617dc424fb46a8d0cb217e524, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-02 21:57:57,490 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting b41afb6f567b4b32b8d1df55af073a55, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-02 21:57:57,490 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting f11bfc83bc98460bac9512cb9da3a1aa, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-02 21:57:57,490 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 7fb51eb3ad454758803b131781284773, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-02 21:57:57,490 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting bebf120ea4894f0a808588e3d9132617, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-02 21:57:57,490 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting feb8dda289944018b3faf3aa70bdc1b1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-02 21:57:57,490 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 460454f389c54e4595d603b8e16ad490, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-02 21:57:57,490 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting e3c47b7804774a33ad933096a589387f_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-02 21:57:57,492 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:57:57,493 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:57,495 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010150afc5300dc1493a9e0aa8f0dbcd95bc to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010150afc5300dc1493a9e0aa8f0dbcd95bc 2023-11-02 21:57:57,497 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1e09621d9dd4c989b9ec47262b3f5a0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1e09621d9dd4c989b9ec47262b3f5a0 2023-11-02 21:57:57,497 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-02 21:57:57,497 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-02 21:57:57,497 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:57:57,497 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:57:57,639 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 164bf322b8449fbcab3e8d323d1a1b84#family1#compaction#166 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-02 21:57:57,658 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/254dd258edf145888ef3f56079260539 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/254dd258edf145888ef3f56079260539 2023-11-02 21:57:57,663 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 164bf322b8449fbcab3e8d323d1a1b84/family1 of 164bf322b8449fbcab3e8d323d1a1b84 into 254dd258edf145888ef3f56079260539(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:57:57,663 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:57,663 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698962277489; duration=0sec 2023-11-02 21:57:57,664 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:57:57,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/10c068300718435ebca602824f25d554, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f1799252e8684d0d89d10401e5e6243e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/981a699617dc424fb46a8d0cb217e524, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/b41afb6f567b4b32b8d1df55af073a55, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f11bfc83bc98460bac9512cb9da3a1aa, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/7fb51eb3ad454758803b131781284773, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/bebf120ea4894f0a808588e3d9132617, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/feb8dda289944018b3faf3aa70bdc1b1, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/460454f389c54e4595d603b8e16ad490, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e3c47b7804774a33ad933096a589387f_SeqId_44_] to archive 2023-11-02 21:57:57,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:57,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/10c068300718435ebca602824f25d554 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/10c068300718435ebca602824f25d554 2023-11-02 21:57:57,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f1799252e8684d0d89d10401e5e6243e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f1799252e8684d0d89d10401e5e6243e 2023-11-02 21:57:57,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/981a699617dc424fb46a8d0cb217e524 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/981a699617dc424fb46a8d0cb217e524 2023-11-02 21:57:57,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/b41afb6f567b4b32b8d1df55af073a55 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/b41afb6f567b4b32b8d1df55af073a55 2023-11-02 21:57:57,714 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f11bfc83bc98460bac9512cb9da3a1aa to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/f11bfc83bc98460bac9512cb9da3a1aa 2023-11-02 21:57:57,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/7fb51eb3ad454758803b131781284773 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/7fb51eb3ad454758803b131781284773 2023-11-02 21:57:57,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/bebf120ea4894f0a808588e3d9132617 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/bebf120ea4894f0a808588e3d9132617 2023-11-02 21:57:57,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/feb8dda289944018b3faf3aa70bdc1b1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/feb8dda289944018b3faf3aa70bdc1b1 2023-11-02 21:57:57,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/460454f389c54e4595d603b8e16ad490 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/460454f389c54e4595d603b8e16ad490 2023-11-02 21:57:57,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e3c47b7804774a33ad933096a589387f_SeqId_44_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e3c47b7804774a33ad933096a589387f_SeqId_44_ 2023-11-02 21:57:58,021 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d42717a5f3f4408eba26fe0588016e2d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d42717a5f3f4408eba26fe0588016e2d 2023-11-02 21:57:58,022 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:57:58,068 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5220070fa96d496fb377aeaecf4e0e2c first=Optional[r1] last=Optional[r4] 2023-11-02 21:57:58,069 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5220070fa96d496fb377aeaecf4e0e2c}] 2023-11-02 21:57:58,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5220070fa96d496fb377aeaecf4e0e2c for inclusion in 164bf322b8449fbcab3e8d323d1a1b84/family1 2023-11-02 21:57:58,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-02 21:57:58,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:57:58,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:58,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5220070fa96d496fb377aeaecf4e0e2c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vejj27frg3b4ij3208493qfplqsl0u74quca61fs2ptd97ng6o9h73tlb01ahvor/family1/5220070fa96d496fb377aeaecf4e0e2c 2023-11-02 21:57:58,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vejj27frg3b4ij3208493qfplqsl0u74quca61fs2ptd97ng6o9h73tlb01ahvor/family1/5220070fa96d496fb377aeaecf4e0e2c as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/59597021aece45abb997dd166c62871c_SeqId_47_ 2023-11-02 21:57:58,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vejj27frg3b4ij3208493qfplqsl0u74quca61fs2ptd97ng6o9h73tlb01ahvor/family1/5220070fa96d496fb377aeaecf4e0e2c into 164bf322b8449fbcab3e8d323d1a1b84/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/59597021aece45abb997dd166c62871c_SeqId_47_ - updating store file list. 2023-11-02 21:57:58,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/59597021aece45abb997dd166c62871c_SeqId_47_ into 164bf322b8449fbcab3e8d323d1a1b84/family1 2023-11-02 21:57:58,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vejj27frg3b4ij3208493qfplqsl0u74quca61fs2ptd97ng6o9h73tlb01ahvor/family1/5220070fa96d496fb377aeaecf4e0e2c into 164bf322b8449fbcab3e8d323d1a1b84/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/59597021aece45abb997dd166c62871c_SeqId_47_) 2023-11-02 21:57:58,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vejj27frg3b4ij3208493qfplqsl0u74quca61fs2ptd97ng6o9h73tlb01ahvor/family1/5220070fa96d496fb377aeaecf4e0e2c 2023-11-02 21:57:58,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-02 21:57:58,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-02 21:57:58,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(1912): 164bf322b8449fbcab3e8d323d1a1b84/family1 is initiating minor compaction (all files) 2023-11-02 21:57:58,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7446fcea; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:57:58,088 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 164bf322b8449fbcab3e8d323d1a1b84/family1 in testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:57:58,088 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/671e30e682f947088c1d525cd79ff6a9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/254dd258edf145888ef3f56079260539, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/59597021aece45abb997dd166c62871c_SeqId_47_] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp, totalSize=178.1 K 2023-11-02 21:57:58,089 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 671e30e682f947088c1d525cd79ff6a9, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878810443 2023-11-02 21:57:58,089 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 254dd258edf145888ef3f56079260539, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621210443 2023-11-02 21:57:58,089 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] compactions.Compactor(207): Compacting 59597021aece45abb997dd166c62871c_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965210443 2023-11-02 21:57:58,090 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:57:58,091 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:58,097 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120114809b54ccb64b0b81a6db203e9564b7 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120114809b54ccb64b0b81a6db203e9564b7 2023-11-02 21:57:58,098 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205068441a6d62945c3a76cf8bd0653d395 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205068441a6d62945c3a76cf8bd0653d395 2023-11-02 21:57:58,100 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512288fe8dbede1db4212b5f3b9df570b5b37 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512288fe8dbede1db4212b5f3b9df570b5b37 2023-11-02 21:57:58,101 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ccd809d3468f4f47bef1162cab7e6db7 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ccd809d3468f4f47bef1162cab7e6db7 2023-11-02 21:57:58,101 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-02 21:57:58,102 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-02 21:57:58,102 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:57:58,102 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:57:58,128 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] throttle.PressureAwareThroughputController(145): 164bf322b8449fbcab3e8d323d1a1b84#family1#compaction#167 average throughput is 7.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-02 21:57:58,214 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/.tmp/family1/8428ae2deee046bfa3f051c1b2665073 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/8428ae2deee046bfa3f051c1b2665073 2023-11-02 21:57:58,219 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 164bf322b8449fbcab3e8d323d1a1b84/family1 of 164bf322b8449fbcab3e8d323d1a1b84 into 8428ae2deee046bfa3f051c1b2665073(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:57:58,220 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:58,220 INFO [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698962278088; duration=0sec 2023-11-02 21:57:58,220 DEBUG [RS:0;jenkins-hbase12:33583-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-02 21:57:58,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/671e30e682f947088c1d525cd79ff6a9, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/254dd258edf145888ef3f56079260539, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/59597021aece45abb997dd166c62871c_SeqId_47_] to archive 2023-11-02 21:57:58,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:58,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/671e30e682f947088c1d525cd79ff6a9 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/671e30e682f947088c1d525cd79ff6a9 2023-11-02 21:57:58,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/254dd258edf145888ef3f56079260539 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/254dd258edf145888ef3f56079260539 2023-11-02 21:57:58,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/59597021aece45abb997dd166c62871c_SeqId_47_ to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/59597021aece45abb997dd166c62871c_SeqId_47_ 2023-11-02 21:57:58,636 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e22ba8630183473cac235b700fc9ca8c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130e22ba8630183473cac235b700fc9ca8c 2023-11-02 21:57:58,637 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:57:58,665 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/572c526e5ec147e4b11ad2f37c227851 first=Optional[r00] last=Optional[r8] 2023-11-02 21:57:58,666 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/572c526e5ec147e4b11ad2f37c227851}] 2023-11-02 21:57:58,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/572c526e5ec147e4b11ad2f37c227851 for inclusion in 164bf322b8449fbcab3e8d323d1a1b84/family1 2023-11-02 21:57:58,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-02 21:57:58,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last= 2023-11-02 21:57:58,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:57:58,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/572c526e5ec147e4b11ad2f37c227851 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2prccf2bu26qj92iegm7kbi4mnrdd8ppj4oa0vj9sb3qfk3enfcr5gb09aui6deh/family1/572c526e5ec147e4b11ad2f37c227851 2023-11-02 21:57:58,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2prccf2bu26qj92iegm7kbi4mnrdd8ppj4oa0vj9sb3qfk3enfcr5gb09aui6deh/family1/572c526e5ec147e4b11ad2f37c227851 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e59df23e56bd425d987641a3ca09639c_SeqId_50_ 2023-11-02 21:57:58,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2prccf2bu26qj92iegm7kbi4mnrdd8ppj4oa0vj9sb3qfk3enfcr5gb09aui6deh/family1/572c526e5ec147e4b11ad2f37c227851 into 164bf322b8449fbcab3e8d323d1a1b84/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e59df23e56bd425d987641a3ca09639c_SeqId_50_ - updating store file list. 2023-11-02 21:57:58,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e59df23e56bd425d987641a3ca09639c_SeqId_50_ into 164bf322b8449fbcab3e8d323d1a1b84/family1 2023-11-02 21:57:58,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2prccf2bu26qj92iegm7kbi4mnrdd8ppj4oa0vj9sb3qfk3enfcr5gb09aui6deh/family1/572c526e5ec147e4b11ad2f37c227851 into 164bf322b8449fbcab3e8d323d1a1b84/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/family1/e59df23e56bd425d987641a3ca09639c_SeqId_50_) 2023-11-02 21:57:58,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2prccf2bu26qj92iegm7kbi4mnrdd8ppj4oa0vj9sb3qfk3enfcr5gb09aui6deh/family1/572c526e5ec147e4b11ad2f37c227851 2023-11-02 21:57:58,684 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:57:58,685 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:57:58,687 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120a76d6697ce4045159f644cf7bd5c2883 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120a76d6697ce4045159f644cf7bd5c2883 2023-11-02 21:57:58,689 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128cbbb3fa619d44080bf1014da41837b2d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128cbbb3fa619d44080bf1014da41837b2d 2023-11-02 21:57:58,690 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113081268abd8fab443ba993e929691d90bf to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113081268abd8fab443ba993e929691d90bf 2023-11-02 21:57:58,691 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-02 21:57:58,691 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-02 21:57:58,691 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:57:58,692 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:57:58,692 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-02 21:57:58,692 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-02 21:57:58,692 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:57:58,695 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-02 21:57:58,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.1490 sec 2023-11-02 21:57:58,954 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=256 (was 251) - Thread LEAK? -, OpenFileDescriptor=673 (was 643) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=152 (was 128) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 176), AvailableMemoryMB=239 (was 234) - AvailableMemoryMB LEAK? - 2023-11-02 21:57:58,969 INFO [Listener at localhost/34483] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=256, OpenFileDescriptor=673, MaxFileDescriptor=60000, SystemLoadAverage=152, ProcessCount=172, AvailableMemoryMB=239 2023-11-02 21:57:58,991 DEBUG [Listener at localhost/34483] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-02 21:57:59,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.HMaster$4(2112): Client=jenkins//136.243.104.168 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x82\xB5\xC4O\xFD\xD1#\xE4tl\x9E\xA6\xC9\xAA\x17\x07"\x10W\x05\xA7\x0F1\x16\xB3\x80f\xC6\x7F\x16\x07\x06|\x07*\x10n4b\xB3\xD0C\xC4\x82n~P~\xB97k'2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-02 21:57:59,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-02 21:57:59,051 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-02 21:57:59,051 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(700): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-02 21:57:59,052 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-02 21:57:59,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-02 21:57:59,053 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd 2023-11-02 21:57:59,053 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:57:59,053 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:57:59,053 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd empty. 2023-11-02 21:57:59,054 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a empty. 2023-11-02 21:57:59,054 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58 empty. 2023-11-02 21:57:59,054 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd 2023-11-02 21:57:59,054 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:57:59,054 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:57:59,054 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-02 21:57:59,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-02 21:57:59,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-02 21:57:59,460 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-02 21:57:59,462 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 44b67dc6c5556e2981535f424f1a8c58, NAME => 'testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x82\xB5\xC4O\xFD\xD1#\xE4tl\x9E\xA6\xC9\xAA\x17\x07"\x10W\x05\xA7\x0F1\x16\xB3\x80f\xC6\x7F\x16\x07\x06|\x07*\x10n4b\xB3\xD0C\xC4\x82n~P~\xB97k'2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:57:59,463 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 011309148e779f051560204d0889ffdd, NAME => 'testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x82\xB5\xC4O\xFD\xD1#\xE4tl\x9E\xA6\xC9\xAA\x17\x07"\x10W\x05\xA7\x0F1\x16\xB3\x80f\xC6\x7F\x16\x07\x06|\x07*\x10n4b\xB3\xD0C\xC4\x82n~P~\xB97k'2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:57:59,463 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5170ff45d70ceacf88cbe6280021175a, NAME => 'testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x82\xB5\xC4O\xFD\xD1#\xE4tl\x9E\xA6\xC9\xAA\x17\x07"\x10W\x05\xA7\x0F1\x16\xB3\x80f\xC6\x7F\x16\x07\x06|\x07*\x10n4b\xB3\xD0C\xC4\x82n~P~\xB97k'2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/.tmp 2023-11-02 21:57:59,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:59,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 011309148e779f051560204d0889ffdd, disabling compactions & flushes 2023-11-02 21:57:59,474 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:57:59,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:57:59,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. after waiting 0 ms 2023-11-02 21:57:59,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:57:59,474 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:57:59,474 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:57:59,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-02 21:57:59,873 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:59,873 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 44b67dc6c5556e2981535f424f1a8c58, disabling compactions & flushes 2023-11-02 21:57:59,873 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:57:59,873 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:57:59,874 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. after waiting 0 ms 2023-11-02 21:57:59,874 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:57:59,874 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:57:59,874 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:57:59,874 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:57:59,874 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 5170ff45d70ceacf88cbe6280021175a, disabling compactions & flushes 2023-11-02 21:57:59,874 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:57:59,874 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:57:59,874 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. after waiting 0 ms 2023-11-02 21:57:59,874 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:57:59,874 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:57:59,874 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:57:59,877 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-02 21:57:59,877 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962279877"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962279877"}]},"ts":"1698962279877"} 2023-11-02 21:57:59,877 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962279877"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962279877"}]},"ts":"1698962279877"} 2023-11-02 21:57:59,878 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698962279877"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698962279877"}]},"ts":"1698962279877"} 2023-11-02 21:57:59,879 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-02 21:57:59,880 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-02 21:57:59,880 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962279880"}]},"ts":"1698962279880"} 2023-11-02 21:57:59,881 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-02 21:57:59,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=011309148e779f051560204d0889ffdd, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5170ff45d70ceacf88cbe6280021175a, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=44b67dc6c5556e2981535f424f1a8c58, ASSIGN}] 2023-11-02 21:57:59,913 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5170ff45d70ceacf88cbe6280021175a, ASSIGN 2023-11-02 21:57:59,913 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=011309148e779f051560204d0889ffdd, ASSIGN 2023-11-02 21:57:59,913 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=44b67dc6c5556e2981535f424f1a8c58, ASSIGN 2023-11-02 21:57:59,914 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5170ff45d70ceacf88cbe6280021175a, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:57:59,914 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=011309148e779f051560204d0889ffdd, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:57:59,914 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=44b67dc6c5556e2981535f424f1a8c58, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33583,1698962105160; forceNewPlan=false, retain=false 2023-11-02 21:58:00,066 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=011309148e779f051560204d0889ffdd, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:00,066 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=5170ff45d70ceacf88cbe6280021175a, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:00,066 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962280066"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962280066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962280066"}]},"ts":"1698962280066"} 2023-11-02 21:58:00,066 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698962280066"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962280066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962280066"}]},"ts":"1698962280066"} 2023-11-02 21:58:00,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 011309148e779f051560204d0889ffdd, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:58:00,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 5170ff45d70ceacf88cbe6280021175a, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:58:00,070 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=44b67dc6c5556e2981535f424f1a8c58, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:00,070 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962280066"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698962280066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698962280066"}]},"ts":"1698962280066"} 2023-11-02 21:58:00,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 44b67dc6c5556e2981535f424f1a8c58, server=jenkins-hbase12.apache.org,33583,1698962105160}] 2023-11-02 21:58:00,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-02 21:58:00,219 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:00,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:00,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 011309148e779f051560204d0889ffdd, NAME => 'testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd.', STARTKEY => '', ENDKEY => '1'} 2023-11-02 21:58:00,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 011309148e779f051560204d0889ffdd 2023-11-02 21:58:00,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:58:00,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 011309148e779f051560204d0889ffdd 2023-11-02 21:58:00,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 011309148e779f051560204d0889ffdd 2023-11-02 21:58:00,242 INFO [StoreOpener-011309148e779f051560204d0889ffdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 011309148e779f051560204d0889ffdd 2023-11-02 21:58:00,243 DEBUG [StoreOpener-011309148e779f051560204d0889ffdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1 2023-11-02 21:58:00,243 DEBUG [StoreOpener-011309148e779f051560204d0889ffdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1 2023-11-02 21:58:00,244 INFO [StoreOpener-011309148e779f051560204d0889ffdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 011309148e779f051560204d0889ffdd columnFamilyName family1 2023-11-02 21:58:00,245 INFO [StoreOpener-011309148e779f051560204d0889ffdd-1] regionserver.HStore(310): Store=011309148e779f051560204d0889ffdd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:58:00,246 INFO [StoreOpener-011309148e779f051560204d0889ffdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 011309148e779f051560204d0889ffdd 2023-11-02 21:58:00,247 DEBUG [StoreOpener-011309148e779f051560204d0889ffdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2 2023-11-02 21:58:00,247 DEBUG [StoreOpener-011309148e779f051560204d0889ffdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2 2023-11-02 21:58:00,247 INFO [StoreOpener-011309148e779f051560204d0889ffdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 011309148e779f051560204d0889ffdd columnFamilyName family2 2023-11-02 21:58:00,248 INFO [StoreOpener-011309148e779f051560204d0889ffdd-1] regionserver.HStore(310): Store=011309148e779f051560204d0889ffdd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:58:00,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd 2023-11-02 21:58:00,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd 2023-11-02 21:58:00,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:58:00,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 011309148e779f051560204d0889ffdd 2023-11-02 21:58:00,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:58:00,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 011309148e779f051560204d0889ffdd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67760224, jitterRate=0.00970602035522461}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:58:00,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:58:00,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd., pid=120, masterSystemTime=1698962280219 2023-11-02 21:58:00,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:00,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:00,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:00,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44b67dc6c5556e2981535f424f1a8c58, NAME => 'testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58.', STARTKEY => '2', ENDKEY => ''} 2023-11-02 21:58:00,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:58:00,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:58:00,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:58:00,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:58:00,260 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=011309148e779f051560204d0889ffdd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:00,261 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962280260"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962280260"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962280260"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962280260"}]},"ts":"1698962280260"} 2023-11-02 21:58:00,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=117 2023-11-02 21:58:00,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 011309148e779f051560204d0889ffdd, server=jenkins-hbase12.apache.org,33583,1698962105160 in 199 msec 2023-11-02 21:58:00,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=011309148e779f051560204d0889ffdd, ASSIGN in 358 msec 2023-11-02 21:58:00,280 INFO [StoreOpener-44b67dc6c5556e2981535f424f1a8c58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:58:00,282 DEBUG [StoreOpener-44b67dc6c5556e2981535f424f1a8c58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1 2023-11-02 21:58:00,282 DEBUG [StoreOpener-44b67dc6c5556e2981535f424f1a8c58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1 2023-11-02 21:58:00,282 INFO [StoreOpener-44b67dc6c5556e2981535f424f1a8c58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44b67dc6c5556e2981535f424f1a8c58 columnFamilyName family1 2023-11-02 21:58:00,283 INFO [StoreOpener-44b67dc6c5556e2981535f424f1a8c58-1] regionserver.HStore(310): Store=44b67dc6c5556e2981535f424f1a8c58/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:58:00,283 INFO [StoreOpener-44b67dc6c5556e2981535f424f1a8c58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:58:00,284 DEBUG [StoreOpener-44b67dc6c5556e2981535f424f1a8c58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2 2023-11-02 21:58:00,284 DEBUG [StoreOpener-44b67dc6c5556e2981535f424f1a8c58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2 2023-11-02 21:58:00,284 INFO [StoreOpener-44b67dc6c5556e2981535f424f1a8c58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44b67dc6c5556e2981535f424f1a8c58 columnFamilyName family2 2023-11-02 21:58:00,285 INFO [StoreOpener-44b67dc6c5556e2981535f424f1a8c58-1] regionserver.HStore(310): Store=44b67dc6c5556e2981535f424f1a8c58/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:58:00,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:58:00,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:58:00,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:58:00,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:58:00,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:58:00,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 44b67dc6c5556e2981535f424f1a8c58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68783659, jitterRate=0.024956390261650085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:58:00,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:58:00,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58., pid=122, masterSystemTime=1698962280219 2023-11-02 21:58:00,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:00,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:00,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:00,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5170ff45d70ceacf88cbe6280021175a, NAME => 'testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a.', STARTKEY => '1', ENDKEY => '2'} 2023-11-02 21:58:00,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:58:00,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-02 21:58:00,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7894): checking encryption for 5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:58:00,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7897): checking classloading for 5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:58:00,291 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=44b67dc6c5556e2981535f424f1a8c58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:00,292 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698962280291"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962280291"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962280291"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962280291"}]},"ts":"1698962280291"} 2023-11-02 21:58:00,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=119 2023-11-02 21:58:00,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 44b67dc6c5556e2981535f424f1a8c58, server=jenkins-hbase12.apache.org,33583,1698962105160 in 222 msec 2023-11-02 21:58:00,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=44b67dc6c5556e2981535f424f1a8c58, ASSIGN in 383 msec 2023-11-02 21:58:00,312 INFO [StoreOpener-5170ff45d70ceacf88cbe6280021175a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:58:00,314 DEBUG [StoreOpener-5170ff45d70ceacf88cbe6280021175a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1 2023-11-02 21:58:00,314 DEBUG [StoreOpener-5170ff45d70ceacf88cbe6280021175a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1 2023-11-02 21:58:00,314 INFO [StoreOpener-5170ff45d70ceacf88cbe6280021175a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5170ff45d70ceacf88cbe6280021175a columnFamilyName family1 2023-11-02 21:58:00,315 INFO [StoreOpener-5170ff45d70ceacf88cbe6280021175a-1] regionserver.HStore(310): Store=5170ff45d70ceacf88cbe6280021175a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:58:00,315 INFO [StoreOpener-5170ff45d70ceacf88cbe6280021175a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:58:00,316 DEBUG [StoreOpener-5170ff45d70ceacf88cbe6280021175a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2 2023-11-02 21:58:00,316 DEBUG [StoreOpener-5170ff45d70ceacf88cbe6280021175a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2 2023-11-02 21:58:00,316 INFO [StoreOpener-5170ff45d70ceacf88cbe6280021175a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5170ff45d70ceacf88cbe6280021175a columnFamilyName family2 2023-11-02 21:58:00,316 INFO [StoreOpener-5170ff45d70ceacf88cbe6280021175a-1] regionserver.HStore(310): Store=5170ff45d70ceacf88cbe6280021175a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-02 21:58:00,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:58:00,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:58:00,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-02 21:58:00,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1055): writing seq id for 5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:58:00,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-02 21:58:00,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1072): Opened 5170ff45d70ceacf88cbe6280021175a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73070095, jitterRate=0.08882926404476166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-02 21:58:00,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(965): Region open journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:58:00,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a., pid=121, masterSystemTime=1698962280219 2023-11-02 21:58:00,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:00,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:00,324 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=5170ff45d70ceacf88cbe6280021175a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:00,324 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698962280324"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698962280324"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698962280324"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698962280324"}]},"ts":"1698962280324"} 2023-11-02 21:58:00,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=118 2023-11-02 21:58:00,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 5170ff45d70ceacf88cbe6280021175a, server=jenkins-hbase12.apache.org,33583,1698962105160 in 257 msec 2023-11-02 21:58:00,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-11-02 21:58:00,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5170ff45d70ceacf88cbe6280021175a, ASSIGN in 417 msec 2023-11-02 21:58:00,330 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-02 21:58:00,330 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698962280330"}]},"ts":"1698962280330"} 2023-11-02 21:58:00,331 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-02 21:58:00,380 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-02 21:58:00,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.3320 sec 2023-11-02 21:58:01,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-02 21:58:01,158 INFO [Listener at localhost/34483] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-02 21:58:01,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:01,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:01,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:01,167 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:58:01,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-02 21:58:01,169 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-02 21:58:01,169 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:58:01,169 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-02 21:58:01,169 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-02 21:58:01,171 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:01,171 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:01,185 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:58:01,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:58:01,185 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:01,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:58:01,185 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:01,185 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:58:01,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:01,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:01,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:58:01,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:01,186 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-02 21:58:01,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-02 21:58:01,186 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-02 21:58:01,186 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:58:01,186 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-02 21:58:01,187 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:01,187 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. started... 2023-11-02 21:58:01,189 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:01,189 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:58:01,189 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:01,189 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:58:01,189 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. started... 2023-11-02 21:58:01,189 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 011309148e779f051560204d0889ffdd 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-02 21:58:01,189 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. started... 2023-11-02 21:58:01,189 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 44b67dc6c5556e2981535f424f1a8c58 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-02 21:58:01,190 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5170ff45d70ceacf88cbe6280021175a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-02 21:58:01,236 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311021c34e2eb69fa4989a705bb6eb6491121 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311021c34e2eb69fa4989a705bb6eb6491121 2023-11-02 21:58:01,649 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/7cc41edc2c6c446ea24c9485a228dc5a 2023-11-02 21:58:01,655 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102c8f0db367d2f41189585acbc469b4a9a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231102c8f0db367d2f41189585acbc469b4a9a 2023-11-02 21:58:01,655 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102495ed475d5794050a1f8ebf7d5637473 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102495ed475d5794050a1f8ebf7d5637473 2023-11-02 21:58:01,671 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/24099511e0cf46bda452832a8aff882e 2023-11-02 21:58:02,072 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/892f6346fe36438794dd43ae9a180072 2023-11-02 21:58:02,084 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102ecd2c13105a04d0f80b93727bb8f1cff to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231102ecd2c13105a04d0f80b93727bb8f1cff 2023-11-02 21:58:02,099 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102797a7cde2dee491aa76fa84f7c8ee774 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231102797a7cde2dee491aa76fa84f7c8ee774 2023-11-02 21:58:02,356 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-02 21:58:02,490 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/a0ed6c7114d04c20a0265b223f2ed338 2023-11-02 21:58:02,498 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/7cc41edc2c6c446ea24c9485a228dc5a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/7cc41edc2c6c446ea24c9485a228dc5a 2023-11-02 21:58:02,505 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/7a07b14fa1ac48f59e853a5a43177cdf 2023-11-02 21:58:02,511 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/24099511e0cf46bda452832a8aff882e as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/24099511e0cf46bda452832a8aff882e 2023-11-02 21:58:02,511 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102d7fe1a53958b46379b88739ba0239685 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231102d7fe1a53958b46379b88739ba0239685 2023-11-02 21:58:02,529 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/7cc41edc2c6c446ea24c9485a228dc5a, entries=4, sequenceid=5, filesize=5.5 K 2023-11-02 21:58:02,529 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/a0ed6c7114d04c20a0265b223f2ed338 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/a0ed6c7114d04c20a0265b223f2ed338 2023-11-02 21:58:02,533 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/a0ed6c7114d04c20a0265b223f2ed338, entries=2, sequenceid=5, filesize=5.1 K 2023-11-02 21:58:02,534 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 011309148e779f051560204d0889ffdd in 1345ms, sequenceid=5, compaction requested=false 2023-11-02 21:58:02,535 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:58:02,535 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:02,535 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:58:02,539 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/24099511e0cf46bda452832a8aff882e, entries=4, sequenceid=5, filesize=5.5 K 2023-11-02 21:58:02,540 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/7a07b14fa1ac48f59e853a5a43177cdf as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/7a07b14fa1ac48f59e853a5a43177cdf 2023-11-02 21:58:02,543 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/7a07b14fa1ac48f59e853a5a43177cdf, entries=2, sequenceid=5, filesize=5.1 K 2023-11-02 21:58:02,544 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5170ff45d70ceacf88cbe6280021175a in 1354ms, sequenceid=5, compaction requested=false 2023-11-02 21:58:02,544 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:58:02,544 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:02,544 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:58:02,917 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/c3231fa10a5d488ba8909c1adb6369f3 2023-11-02 21:58:02,926 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/892f6346fe36438794dd43ae9a180072 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/892f6346fe36438794dd43ae9a180072 2023-11-02 21:58:02,953 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/892f6346fe36438794dd43ae9a180072, entries=4, sequenceid=5, filesize=5.5 K 2023-11-02 21:58:02,954 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/c3231fa10a5d488ba8909c1adb6369f3 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c3231fa10a5d488ba8909c1adb6369f3 2023-11-02 21:58:02,957 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c3231fa10a5d488ba8909c1adb6369f3, entries=2, sequenceid=5, filesize=5.1 K 2023-11-02 21:58:02,958 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 44b67dc6c5556e2981535f424f1a8c58 in 1769ms, sequenceid=5, compaction requested=false 2023-11-02 21:58:02,958 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:58:02,958 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:02,958 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:58:02,958 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:58:02,958 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:02,958 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-02 21:58:02,958 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-02 21:58:03,056 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,056 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:03,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:03,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:03,056 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:03,056 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:58:03,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:03,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:03,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:03,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:03,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-02 21:58:03,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6df67d0b[Count = 0] remaining members to acquire global barrier 2023-11-02 21:58:03,058 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-02 21:58:03,058 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:03,079 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:03,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:03,079 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-02 21:58:03,079 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,079 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:58:03,079 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-02 21:58:03,080 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:58:03,090 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,090 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-02 21:58:03,090 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:58:03,090 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-02 21:58:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:58:03,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-02 21:58:03,092 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-02 21:58:03,092 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:58:03,092 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:58:03,092 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-02 21:58:03,092 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:58:03,100 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:03,100 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:03,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:03,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:03,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:03,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:03,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:03,100 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:58:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:03,101 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:58:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:58:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,102 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:58:03,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:03,111 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-02 21:58:03,111 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:58:03,111 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:58:03,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:58:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:58:03,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:58:03,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-02 21:58:03,111 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-02 21:58:03,111 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:58:03,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:03,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:58:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:58:03,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:03,111 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:03,112 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:03,211 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:58:03,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:58:03,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:03,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:03,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:03,216 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:58:03,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-02 21:58:03,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-02 21:58:03,218 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-02 21:58:03,218 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:58:03,218 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-02 21:58:03,218 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-02 21:58:03,218 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:03,218 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:03,289 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:58:03,289 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:58:03,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:58:03,290 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:03,290 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:58:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:03,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:58:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:03,290 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-02 21:58:03,290 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-02 21:58:03,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-02 21:58:03,290 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-02 21:58:03,290 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:58:03,290 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-02 21:58:03,291 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:03,291 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:03,291 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:58:03,291 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:03,291 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. started... 2023-11-02 21:58:03,291 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. started... 2023-11-02 21:58:03,291 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. started... 2023-11-02 21:58:03,291 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:58:03,291 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5170ff45d70ceacf88cbe6280021175a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-02 21:58:03,291 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 44b67dc6c5556e2981535f424f1a8c58 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-02 21:58:03,291 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 011309148e779f051560204d0889ffdd 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-02 21:58:03,331 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102ac71da25013c47cd9e39db0eb26f22b1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102ac71da25013c47cd9e39db0eb26f22b1 2023-11-02 21:58:03,336 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102ca3198b7a9cc423ba1841368c06a5dc1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231102ca3198b7a9cc423ba1841368c06a5dc1 2023-11-02 21:58:03,344 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/7777fe7f56e84da69e2a6f3c287a47c7 2023-11-02 21:58:03,358 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:58:03,358 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110229cb3a8ac27d456891ba44f97adf0b2d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110229cb3a8ac27d456891ba44f97adf0b2d 2023-11-02 21:58:03,358 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x540d5c3c to 127.0.0.1:49550 2023-11-02 21:58:03,358 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:58:03,358 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:58:03,358 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40a7e504 to 127.0.0.1:49550 2023-11-02 21:58:03,358 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:58:03,366 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/721818279eed4faf9590f0f2c5a66036 2023-11-02 21:58:03,379 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/63b0ddb3f36541698887cbb41da4f7e6 2023-11-02 21:58:03,397 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102256b308ae38947cba0682653a8e56111 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231102256b308ae38947cba0682653a8e56111 2023-11-02 21:58:03,404 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/f97d81834f574c5e93bc0fe9702d938d 2023-11-02 21:58:03,408 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/7777fe7f56e84da69e2a6f3c287a47c7 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/7777fe7f56e84da69e2a6f3c287a47c7 2023-11-02 21:58:03,430 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/7777fe7f56e84da69e2a6f3c287a47c7, entries=4, sequenceid=9, filesize=5.5 K 2023-11-02 21:58:03,431 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/f97d81834f574c5e93bc0fe9702d938d as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f97d81834f574c5e93bc0fe9702d938d 2023-11-02 21:58:03,434 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f97d81834f574c5e93bc0fe9702d938d, entries=2, sequenceid=9, filesize=5.1 K 2023-11-02 21:58:03,434 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5170ff45d70ceacf88cbe6280021175a in 143ms, sequenceid=9, compaction requested=false 2023-11-02 21:58:03,435 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:58:03,435 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:03,435 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:58:03,802 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110268a6792c43c14934af1fdb2b28d24f09 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110268a6792c43c14934af1fdb2b28d24f09 2023-11-02 21:58:03,814 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110239dd3e5aa3dc4d9ab30bf697596595ad to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023110239dd3e5aa3dc4d9ab30bf697596595ad 2023-11-02 21:58:04,210 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/777279ebbc154a71bf08376b72ce0e00 2023-11-02 21:58:04,214 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/721818279eed4faf9590f0f2c5a66036 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/721818279eed4faf9590f0f2c5a66036 2023-11-02 21:58:04,220 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/c51beb510f014abc903a9973fe36a182 2023-11-02 21:58:04,224 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/63b0ddb3f36541698887cbb41da4f7e6 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/63b0ddb3f36541698887cbb41da4f7e6 2023-11-02 21:58:04,237 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/721818279eed4faf9590f0f2c5a66036, entries=4, sequenceid=9, filesize=5.5 K 2023-11-02 21:58:04,237 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/777279ebbc154a71bf08376b72ce0e00 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/777279ebbc154a71bf08376b72ce0e00 2023-11-02 21:58:04,240 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/777279ebbc154a71bf08376b72ce0e00, entries=2, sequenceid=9, filesize=5.1 K 2023-11-02 21:58:04,241 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 011309148e779f051560204d0889ffdd in 950ms, sequenceid=9, compaction requested=false 2023-11-02 21:58:04,241 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:58:04,241 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:04,241 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:58:04,245 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/63b0ddb3f36541698887cbb41da4f7e6, entries=4, sequenceid=9, filesize=5.5 K 2023-11-02 21:58:04,245 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/c51beb510f014abc903a9973fe36a182 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c51beb510f014abc903a9973fe36a182 2023-11-02 21:58:04,249 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c51beb510f014abc903a9973fe36a182, entries=2, sequenceid=9, filesize=5.1 K 2023-11-02 21:58:04,249 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 44b67dc6c5556e2981535f424f1a8c58 in 958ms, sequenceid=9, compaction requested=false 2023-11-02 21:58:04,249 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:58:04,249 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:04,249 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:58:04,249 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:58:04,250 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,250 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-02 21:58:04,250 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-02 21:58:04,313 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,313 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:04,314 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:04,314 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:58:04,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:04,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:04,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:04,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-02 21:58:04,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d47ca83[Count = 0] remaining members to acquire global barrier 2023-11-02 21:58:04,319 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-02 21:58:04,319 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:04,441 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:04,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:04,442 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-02 21:58:04,442 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-02 21:58:04,442 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:58:04,442 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,443 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:58:04,586 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-02 21:58:04,586 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,587 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:58:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:04,587 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-02 21:58:04,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:04,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:04,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:04,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:04,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:58:04,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-02 21:58:04,594 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-02 21:58:04,594 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:58:04,594 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:58:04,594 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-02 21:58:04,594 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:58:04,702 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:04,702 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:04,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:04,702 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:58:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:04,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:58:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:58:04,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:04,703 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:04,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:04,704 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:04,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,827 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,827 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:04,827 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:58:04,827 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:04,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:58:04,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-02 21:58:04,828 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-02 21:58:04,828 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:58:04,827 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:58:04,827 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,827 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:58:04,829 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:04,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:58:04,829 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:04,829 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-02 21:58:04,829 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:58:04,829 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:04,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:58:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:58:04,930 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:58:04,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:58:04,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:04,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:04,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:04,940 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:58:04,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-02 21:58:04,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-02 21:58:04,943 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-02 21:58:04,943 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:58:04,943 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-02 21:58:04,943 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-02 21:58:04,943 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:04,944 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:04,998 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,998 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:58:04,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:58:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:58:04,999 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:04,999 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:58:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:04,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:05,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:58:05,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:05,000 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-02 21:58:05,001 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-02 21:58:05,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-02 21:58:05,001 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-02 21:58:05,001 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:58:05,001 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-02 21:58:05,001 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:05,002 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. started... 2023-11-02 21:58:05,002 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:58:05,002 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:58:05,002 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 011309148e779f051560204d0889ffdd 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-02 21:58:05,002 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:05,002 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. started... 2023-11-02 21:58:05,002 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:05,002 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 44b67dc6c5556e2981535f424f1a8c58 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-02 21:58:05,002 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. started... 2023-11-02 21:58:05,002 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5170ff45d70ceacf88cbe6280021175a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-02 21:58:05,452 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110217cdf77a27d1480292844446e379a26c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110217cdf77a27d1480292844446e379a26c 2023-11-02 21:58:05,452 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110232ce179c51374422ba872587cf148477 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110232ce179c51374422ba872587cf148477 2023-11-02 21:58:05,452 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102b90c56d32940461a84f31c3c34ac8ffb to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102b90c56d32940461a84f31c3c34ac8ffb 2023-11-02 21:58:05,484 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/380955f749d1437cb434d1ac10b6de92 2023-11-02 21:58:05,484 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/c67c120690bf4606bc4139cba7fd68e8 2023-11-02 21:58:05,486 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/7734015b7af24edfad0078313f845a53 2023-11-02 21:58:05,518 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110253a75b2574ec4297a9a8191588851300 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023110253a75b2574ec4297a9a8191588851300 2023-11-02 21:58:05,528 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102126841ad587242638a9934bb5b8e5bb7 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231102126841ad587242638a9934bb5b8e5bb7 2023-11-02 21:58:05,530 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110275bebfaa08cc431fb9ad4dad81f211ec to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023110275bebfaa08cc431fb9ad4dad81f211ec 2023-11-02 21:58:05,760 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-02 21:58:05,924 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/f6215d31285446798e4fb07aff326e72 2023-11-02 21:58:05,929 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/c67c120690bf4606bc4139cba7fd68e8 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/c67c120690bf4606bc4139cba7fd68e8 2023-11-02 21:58:05,933 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/dc415b1099cf4af9a687eaad53da375f 2023-11-02 21:58:05,938 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/380955f749d1437cb434d1ac10b6de92 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/380955f749d1437cb434d1ac10b6de92 2023-11-02 21:58:05,939 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/380b21a6943f4ee187f8d6757cb6981e 2023-11-02 21:58:05,942 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/7734015b7af24edfad0078313f845a53 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7734015b7af24edfad0078313f845a53 2023-11-02 21:58:05,952 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/c67c120690bf4606bc4139cba7fd68e8, entries=4, sequenceid=13, filesize=5.5 K 2023-11-02 21:58:05,953 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/f6215d31285446798e4fb07aff326e72 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f6215d31285446798e4fb07aff326e72 2023-11-02 21:58:05,956 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f6215d31285446798e4fb07aff326e72, entries=2, sequenceid=13, filesize=5.1 K 2023-11-02 21:58:05,957 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5170ff45d70ceacf88cbe6280021175a in 955ms, sequenceid=13, compaction requested=true 2023-11-02 21:58:05,957 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:58:05,957 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:05,957 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:58:05,958 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/380955f749d1437cb434d1ac10b6de92, entries=4, sequenceid=13, filesize=5.5 K 2023-11-02 21:58:05,958 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/dc415b1099cf4af9a687eaad53da375f as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/dc415b1099cf4af9a687eaad53da375f 2023-11-02 21:58:05,962 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/dc415b1099cf4af9a687eaad53da375f, entries=2, sequenceid=13, filesize=5.1 K 2023-11-02 21:58:05,962 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7734015b7af24edfad0078313f845a53, entries=4, sequenceid=13, filesize=5.5 K 2023-11-02 21:58:05,962 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 011309148e779f051560204d0889ffdd in 960ms, sequenceid=13, compaction requested=true 2023-11-02 21:58:05,962 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/380b21a6943f4ee187f8d6757cb6981e as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/380b21a6943f4ee187f8d6757cb6981e 2023-11-02 21:58:05,962 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:58:05,962 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:05,963 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:58:05,965 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/380b21a6943f4ee187f8d6757cb6981e, entries=2, sequenceid=13, filesize=5.1 K 2023-11-02 21:58:05,966 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 44b67dc6c5556e2981535f424f1a8c58 in 964ms, sequenceid=13, compaction requested=true 2023-11-02 21:58:05,966 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:58:05,966 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:05,966 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:58:05,966 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:58:05,966 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:05,966 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-02 21:58:05,966 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-02 21:58:05,979 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:05,979 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:05,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:05,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:05,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:05,980 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:05,980 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:58:05,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:05,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:05,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:05,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:05,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:05,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-02 21:58:05,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@82b6a66[Count = 0] remaining members to acquire global barrier 2023-11-02 21:58:05,982 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-02 21:58:05,982 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:06,000 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:06,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:06,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:06,001 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-02 21:58:06,001 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-02 21:58:06,001 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:58:06,001 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,001 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:58:06,022 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,022 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-02 21:58:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,022 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:58:06,022 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-02 21:58:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:58:06,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-02 21:58:06,025 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-02 21:58:06,025 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:58:06,025 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:58:06,025 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-02 21:58:06,025 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:58:06,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:06,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:06,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:06,043 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:58:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:06,043 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:58:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:58:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,045 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:06,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,124 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:58:06,124 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,124 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:58:06,124 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:06,124 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:06,124 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-02 21:58:06,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:58:06,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:58:06,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:58:06,124 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:58:06,124 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:06,125 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:06,125 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-02 21:58:06,125 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:06,125 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:58:06,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:58:06,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:58:06,225 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:58:06,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:58:06,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:06,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:06,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. with WAL disabled. Data may be lost in the event of a crash. 2023-11-02 21:58:06,229 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:58:06,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-02 21:58:06,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-02 21:58:06,231 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-02 21:58:06,231 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:58:06,231 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-02 21:58:06,231 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-02 21:58:06,231 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:06,231 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:06,243 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:58:06,243 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:58:06,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:58:06,243 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:06,243 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:58:06,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:06,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:06,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:58:06,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:06,244 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-02 21:58:06,244 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-02 21:58:06,244 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-02 21:58:06,244 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-02 21:58:06,244 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:58:06,245 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-02 21:58:06,245 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:06,245 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:06,245 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:58:06,245 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:58:06,245 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. started... 2023-11-02 21:58:06,245 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:06,245 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. started... 2023-11-02 21:58:06,245 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 011309148e779f051560204d0889ffdd 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-02 21:58:06,245 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. started... 2023-11-02 21:58:06,245 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 44b67dc6c5556e2981535f424f1a8c58 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-02 21:58:06,245 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5170ff45d70ceacf88cbe6280021175a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-02 21:58:06,291 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102e901d85ce8d54b81af71ed5b304cbf6c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102e901d85ce8d54b81af71ed5b304cbf6c 2023-11-02 21:58:06,293 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110249146eeae11d40909ccbaf03f18cf97a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110249146eeae11d40909ccbaf03f18cf97a 2023-11-02 21:58:06,304 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/48cba170a5644f1ca8b99fe77e8ae669 2023-11-02 21:58:06,307 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/7219c3b699704dbea248159eb4ba882d 2023-11-02 21:58:06,688 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231102b14bfc47c07f459596cde8b389d625b5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231102b14bfc47c07f459596cde8b389d625b5 2023-11-02 21:58:06,748 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102ce56098502cb418c943ca87e2a268596 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231102ce56098502cb418c943ca87e2a268596 2023-11-02 21:58:06,748 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110272060b138b6e474d9070afee541cd051 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023110272060b138b6e474d9070afee541cd051 2023-11-02 21:58:07,101 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/4049859ba24e46af96b79c10a0e51d2a 2023-11-02 21:58:07,142 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110231024d78f1504b148ee71e766493b0b2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110231024d78f1504b148ee71e766493b0b2 2023-11-02 21:58:07,152 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/d00c80dc8d934c128ae9c58064d6285b 2023-11-02 21:58:07,152 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/ab79212fd81440a18a3959ae2d362175 2023-11-02 21:58:07,156 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/7219c3b699704dbea248159eb4ba882d as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7219c3b699704dbea248159eb4ba882d 2023-11-02 21:58:07,156 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/48cba170a5644f1ca8b99fe77e8ae669 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/48cba170a5644f1ca8b99fe77e8ae669 2023-11-02 21:58:07,175 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7219c3b699704dbea248159eb4ba882d, entries=4, sequenceid=17, filesize=5.5 K 2023-11-02 21:58:07,175 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/48cba170a5644f1ca8b99fe77e8ae669, entries=4, sequenceid=17, filesize=5.5 K 2023-11-02 21:58:07,176 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/ab79212fd81440a18a3959ae2d362175 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/ab79212fd81440a18a3959ae2d362175 2023-11-02 21:58:07,176 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/d00c80dc8d934c128ae9c58064d6285b as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/d00c80dc8d934c128ae9c58064d6285b 2023-11-02 21:58:07,181 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/d00c80dc8d934c128ae9c58064d6285b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-02 21:58:07,181 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/ab79212fd81440a18a3959ae2d362175, entries=2, sequenceid=17, filesize=5.1 K 2023-11-02 21:58:07,182 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5170ff45d70ceacf88cbe6280021175a in 936ms, sequenceid=17, compaction requested=true 2023-11-02 21:58:07,182 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 44b67dc6c5556e2981535f424f1a8c58 in 936ms, sequenceid=17, compaction requested=true 2023-11-02 21:58:07,182 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:58:07,182 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:58:07,182 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:07,182 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:07,182 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:58:07,182 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:58:07,548 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/2dec59403aa4459cb76b279672bc8570 2023-11-02 21:58:07,559 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/4049859ba24e46af96b79c10a0e51d2a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/4049859ba24e46af96b79c10a0e51d2a 2023-11-02 21:58:07,581 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/4049859ba24e46af96b79c10a0e51d2a, entries=4, sequenceid=17, filesize=5.5 K 2023-11-02 21:58:07,582 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/2dec59403aa4459cb76b279672bc8570 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/2dec59403aa4459cb76b279672bc8570 2023-11-02 21:58:07,586 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/2dec59403aa4459cb76b279672bc8570, entries=2, sequenceid=17, filesize=5.1 K 2023-11-02 21:58:07,586 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 011309148e779f051560204d0889ffdd in 1341ms, sequenceid=17, compaction requested=true 2023-11-02 21:58:07,586 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:58:07,587 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:07,587 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:58:07,587 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:58:07,587 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,587 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-02 21:58:07,587 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-02 21:58:07,605 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:07,605 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:07,606 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:07,606 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:58:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:07,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-02 21:58:07,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73a99d68[Count = 0] remaining members to acquire global barrier 2023-11-02 21:58:07,608 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-02 21:58:07,608 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:07,616 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:07,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:07,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:07,616 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-02 21:58:07,616 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-02 21:58:07,616 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:58:07,616 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,617 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:58:07,626 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-02 21:58:07,627 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:58:07,626 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,627 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-02 21:58:07,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:07,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:07,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:07,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:07,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:07,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:07,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:58:07,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-02 21:58:07,633 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-02 21:58:07,634 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:58:07,634 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:58:07,634 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-02 21:58:07,634 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:58:07,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:07,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:07,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:07,643 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:58:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:07,643 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:58:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:58:07,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:07,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:07,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:07,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:07,645 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:07,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:07,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:58:07,658 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:58:07,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:07,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:58:07,658 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-02 21:58:07,658 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:58:07,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-02 21:58:07,658 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:58:07,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:58:07,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:58:07,759 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:58:07,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:58:07,774 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:58:07,780 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:58:07,787 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:58:07,788 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:58:07,864 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(936): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-11-02 21:58:07,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-02 21:58:07,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-02 21:58:07,865 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-02 21:58:07,865 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:58:07,865 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-02 21:58:07,865 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-02 21:58:07,866 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:07,866 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:07,879 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:58:07,879 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:58:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:58:07,879 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:07,880 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-02 21:58:07,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:07,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:07,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-02 21:58:07,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:07,881 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-02 21:58:07,881 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-02 21:58:07,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-02 21:58:07,881 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-02 21:58:07,881 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-02 21:58:07,881 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-02 21:58:07,881 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:07,881 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. started... 2023-11-02 21:58:07,881 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:07,881 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 011309148e779f051560204d0889ffdd 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-02 21:58:07,882 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:07,882 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. started... 2023-11-02 21:58:07,881 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. started... 2023-11-02 21:58:07,882 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5170ff45d70ceacf88cbe6280021175a 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-02 21:58:07,881 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-02 21:58:07,882 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-02 21:58:07,882 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 44b67dc6c5556e2981535f424f1a8c58 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-02 21:58:08,326 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/5180c714e00145a2ae3d43625b29213f 2023-11-02 21:58:08,350 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5180c714e00145a2ae3d43625b29213f 2023-11-02 21:58:08,725 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/e80b438eefe14072b66ffef1ee5beda0 2023-11-02 21:58:08,725 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/09142f42665f484aa1bbe7dbe010103b 2023-11-02 21:58:08,755 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09142f42665f484aa1bbe7dbe010103b 2023-11-02 21:58:08,761 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/4b138371a9d04f14acf59a826937cc09 2023-11-02 21:58:08,763 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e80b438eefe14072b66ffef1ee5beda0 2023-11-02 21:58:08,764 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b138371a9d04f14acf59a826937cc09 2023-11-02 21:58:08,765 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/5180c714e00145a2ae3d43625b29213f as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/5180c714e00145a2ae3d43625b29213f 2023-11-02 21:58:08,812 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5180c714e00145a2ae3d43625b29213f 2023-11-02 21:58:08,812 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/5180c714e00145a2ae3d43625b29213f, entries=3, sequenceid=23, filesize=5.2 K 2023-11-02 21:58:08,813 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/4b138371a9d04f14acf59a826937cc09 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/4b138371a9d04f14acf59a826937cc09 2023-11-02 21:58:08,816 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b138371a9d04f14acf59a826937cc09 2023-11-02 21:58:08,816 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/4b138371a9d04f14acf59a826937cc09, entries=1, sequenceid=23, filesize=5.0 K 2023-11-02 21:58:08,817 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 011309148e779f051560204d0889ffdd in 936ms, sequenceid=23, compaction requested=true 2023-11-02 21:58:08,817 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:58:08,817 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:08,817 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-02 21:58:09,171 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/95d51ff460da4964b992792073268b6d 2023-11-02 21:58:09,175 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95d51ff460da4964b992792073268b6d 2023-11-02 21:58:09,176 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/09142f42665f484aa1bbe7dbe010103b as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/09142f42665f484aa1bbe7dbe010103b 2023-11-02 21:58:09,198 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09142f42665f484aa1bbe7dbe010103b 2023-11-02 21:58:09,198 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/09142f42665f484aa1bbe7dbe010103b, entries=3, sequenceid=23, filesize=5.2 K 2023-11-02 21:58:09,199 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/95d51ff460da4964b992792073268b6d as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/95d51ff460da4964b992792073268b6d 2023-11-02 21:58:09,202 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95d51ff460da4964b992792073268b6d 2023-11-02 21:58:09,202 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/95d51ff460da4964b992792073268b6d, entries=1, sequenceid=23, filesize=5.0 K 2023-11-02 21:58:09,203 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5170ff45d70ceacf88cbe6280021175a in 1321ms, sequenceid=23, compaction requested=true 2023-11-02 21:58:09,203 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:58:09,203 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:09,203 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-02 21:58:09,210 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/d2cf3406dd0e44758592b9b179a6ca52 2023-11-02 21:58:09,214 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2cf3406dd0e44758592b9b179a6ca52 2023-11-02 21:58:09,215 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/e80b438eefe14072b66ffef1ee5beda0 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/e80b438eefe14072b66ffef1ee5beda0 2023-11-02 21:58:09,238 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e80b438eefe14072b66ffef1ee5beda0 2023-11-02 21:58:09,238 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/e80b438eefe14072b66ffef1ee5beda0, entries=3, sequenceid=23, filesize=5.2 K 2023-11-02 21:58:09,239 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/d2cf3406dd0e44758592b9b179a6ca52 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/d2cf3406dd0e44758592b9b179a6ca52 2023-11-02 21:58:09,243 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2cf3406dd0e44758592b9b179a6ca52 2023-11-02 21:58:09,243 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/d2cf3406dd0e44758592b9b179a6ca52, entries=1, sequenceid=23, filesize=5.0 K 2023-11-02 21:58:09,244 INFO [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 44b67dc6c5556e2981535f424f1a8c58 in 1362ms, sequenceid=23, compaction requested=true 2023-11-02 21:58:09,244 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:58:09,244 DEBUG [rs(jenkins-hbase12.apache.org,33583,1698962105160)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:09,244 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-02 21:58:09,244 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-02 21:58:09,244 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,244 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-02 21:58:09,244 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-02 21:58:09,253 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,253 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:09,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:09,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:09,253 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:09,253 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-02 21:58:09,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:09,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:09,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:09,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:09,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33583,1698962105160' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-02 21:58:09,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d69b833[Count = 0] remaining members to acquire global barrier 2023-11-02 21:58:09,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-02 21:58:09,255 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:09,263 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:09,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:09,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:09,264 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-02 21:58:09,264 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-02 21:58:09,264 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,33583,1698962105160' in zk 2023-11-02 21:58:09,264 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,264 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-02 21:58:09,274 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-02 21:58:09,274 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:58:09,274 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,274 DEBUG [member: 'jenkins-hbase12.apache.org,33583,1698962105160' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-02 21:58:09,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:09,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:09,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:09,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:09,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,33583,1698962105160': 2023-11-02 21:58:09,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33583,1698962105160' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-02 21:58:09,280 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-02 21:58:09,280 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-02 21:58:09,280 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-02 21:58:09,280 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-02 21:58:09,280 INFO [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-02 21:58:09,289 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:09,290 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:09,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:09,290 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:58:09,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:09,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:09,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-02 21:58:09,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-02 21:58:09,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:58:09,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:58:09,291 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-02 21:58:09,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-02 21:58:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:09,293 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-02 21:58:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-02 21:58:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-02 21:58:09,306 DEBUG [(jenkins-hbase12.apache.org,40055,1698962103892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-02 21:58:09,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:09,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-02 21:58:09,306 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-02 21:58:09,306 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-02 21:58:09,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-02 21:58:09,306 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-02 21:58:09,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-02 21:58:09,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-02 21:58:09,406 DEBUG [Listener at localhost/34483] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-02 21:58:09,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40055] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-02 21:58:09,407 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:58:09,408 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 011309148e779f051560204d0889ffdd/family1 is initiating major compaction (all files) 2023-11-02 21:58:09,408 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:58:09,408 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:58:09,408 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 011309148e779f051560204d0889ffdd/family1 in testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:09,408 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/7cc41edc2c6c446ea24c9485a228dc5a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/721818279eed4faf9590f0f2c5a66036, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/380955f749d1437cb434d1ac10b6de92, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/4049859ba24e46af96b79c10a0e51d2a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/5180c714e00145a2ae3d43625b29213f] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp, totalSize=27.1 K 2023-11-02 21:58:09,409 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 7cc41edc2c6c446ea24c9485a228dc5a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962281164 2023-11-02 21:58:09,409 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 721818279eed4faf9590f0f2c5a66036, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962283213 2023-11-02 21:58:09,409 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 380955f749d1437cb434d1ac10b6de92, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962284933 2023-11-02 21:58:09,410 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 4049859ba24e46af96b79c10a0e51d2a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962286226 2023-11-02 21:58:09,410 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 5180c714e00145a2ae3d43625b29213f, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:58:09,421 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 011309148e779f051560204d0889ffdd#family1#compaction#198 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:58:09,861 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311022eb3c5bad2c943e9a7c00491aee5d915_del 2023-11-02 21:58:09,861 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311022eb3c5bad2c943e9a7c00491aee5d915_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311022eb3c5bad2c943e9a7c00491aee5d915_del 2023-11-02 21:58:10,718 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 294bbc252e6d4dcf9316b1c330319607 2023-11-02 21:58:10,719 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family1/294bbc252e6d4dcf9316b1c330319607 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/294bbc252e6d4dcf9316b1c330319607 2023-11-02 21:58:10,741 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 294bbc252e6d4dcf9316b1c330319607 2023-11-02 21:58:10,742 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 011309148e779f051560204d0889ffdd/family1 of 011309148e779f051560204d0889ffdd into 294bbc252e6d4dcf9316b1c330319607(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:58:10,742 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:58:10,742 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:58:10,742 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 011309148e779f051560204d0889ffdd/family2 is initiating major compaction (all files) 2023-11-02 21:58:10,743 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:58:10,743 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:58:10,743 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 011309148e779f051560204d0889ffdd/family2 in testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:10,743 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/a0ed6c7114d04c20a0265b223f2ed338, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/777279ebbc154a71bf08376b72ce0e00, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/dc415b1099cf4af9a687eaad53da375f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/2dec59403aa4459cb76b279672bc8570, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/4b138371a9d04f14acf59a826937cc09] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp, totalSize=25.4 K 2023-11-02 21:58:10,744 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting a0ed6c7114d04c20a0265b223f2ed338, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962281164 2023-11-02 21:58:10,744 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 777279ebbc154a71bf08376b72ce0e00, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962283213 2023-11-02 21:58:10,745 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting dc415b1099cf4af9a687eaad53da375f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962284933 2023-11-02 21:58:10,745 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 2dec59403aa4459cb76b279672bc8570, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962286226 2023-11-02 21:58:10,745 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 4b138371a9d04f14acf59a826937cc09, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:58:10,758 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 011309148e779f051560204d0889ffdd#family2#compaction#199 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:58:10,764 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023110248951dd389db4d45b9ffca5ae8946b53_del 2023-11-02 21:58:10,765 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110248951dd389db4d45b9ffca5ae8946b53_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110248951dd389db4d45b9ffca5ae8946b53_del 2023-11-02 21:58:10,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/7cc41edc2c6c446ea24c9485a228dc5a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/721818279eed4faf9590f0f2c5a66036, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/380955f749d1437cb434d1ac10b6de92, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/4049859ba24e46af96b79c10a0e51d2a, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/5180c714e00145a2ae3d43625b29213f] to archive 2023-11-02 21:58:10,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:10,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/7cc41edc2c6c446ea24c9485a228dc5a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/7cc41edc2c6c446ea24c9485a228dc5a 2023-11-02 21:58:10,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/721818279eed4faf9590f0f2c5a66036 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/721818279eed4faf9590f0f2c5a66036 2023-11-02 21:58:10,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/380955f749d1437cb434d1ac10b6de92 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/380955f749d1437cb434d1ac10b6de92 2023-11-02 21:58:10,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/4049859ba24e46af96b79c10a0e51d2a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/4049859ba24e46af96b79c10a0e51d2a 2023-11-02 21:58:10,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/5180c714e00145a2ae3d43625b29213f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/5180c714e00145a2ae3d43625b29213f 2023-11-02 21:58:11,214 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-02 21:58:11,584 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5adb2666f7cb412ba44411e1aec024c5 2023-11-02 21:58:11,585 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/.tmp/family2/5adb2666f7cb412ba44411e1aec024c5 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/5adb2666f7cb412ba44411e1aec024c5 2023-11-02 21:58:11,591 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5adb2666f7cb412ba44411e1aec024c5 2023-11-02 21:58:11,593 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 011309148e779f051560204d0889ffdd/family2 of 011309148e779f051560204d0889ffdd into 5adb2666f7cb412ba44411e1aec024c5(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:58:11,593 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:58:11,593 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:58:11,593 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 44b67dc6c5556e2981535f424f1a8c58/family1 is initiating major compaction (all files) 2023-11-02 21:58:11,594 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:58:11,594 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:58:11,594 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 44b67dc6c5556e2981535f424f1a8c58/family1 in testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:11,594 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/892f6346fe36438794dd43ae9a180072, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/63b0ddb3f36541698887cbb41da4f7e6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7734015b7af24edfad0078313f845a53, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7219c3b699704dbea248159eb4ba882d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/e80b438eefe14072b66ffef1ee5beda0] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp, totalSize=27.1 K 2023-11-02 21:58:11,595 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 892f6346fe36438794dd43ae9a180072, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962281165 2023-11-02 21:58:11,595 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 63b0ddb3f36541698887cbb41da4f7e6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962283213 2023-11-02 21:58:11,596 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 7734015b7af24edfad0078313f845a53, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962284934 2023-11-02 21:58:11,597 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 7219c3b699704dbea248159eb4ba882d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962286227 2023-11-02 21:58:11,597 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting e80b438eefe14072b66ffef1ee5beda0, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:58:11,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/a0ed6c7114d04c20a0265b223f2ed338, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/777279ebbc154a71bf08376b72ce0e00, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/dc415b1099cf4af9a687eaad53da375f, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/2dec59403aa4459cb76b279672bc8570, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/4b138371a9d04f14acf59a826937cc09] to archive 2023-11-02 21:58:11,606 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 44b67dc6c5556e2981535f424f1a8c58#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:58:11,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:11,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/a0ed6c7114d04c20a0265b223f2ed338 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/a0ed6c7114d04c20a0265b223f2ed338 2023-11-02 21:58:11,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/777279ebbc154a71bf08376b72ce0e00 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/777279ebbc154a71bf08376b72ce0e00 2023-11-02 21:58:11,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/dc415b1099cf4af9a687eaad53da375f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/dc415b1099cf4af9a687eaad53da375f 2023-11-02 21:58:11,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/2dec59403aa4459cb76b279672bc8570 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/2dec59403aa4459cb76b279672bc8570 2023-11-02 21:58:11,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/4b138371a9d04f14acf59a826937cc09 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family2/4b138371a9d04f14acf59a826937cc09 2023-11-02 21:58:11,641 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231102cb3d1358b4e643e58eaa79cdce62b97c_del 2023-11-02 21:58:11,641 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102cb3d1358b4e643e58eaa79cdce62b97c_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231102cb3d1358b4e643e58eaa79cdce62b97c_del 2023-11-02 21:58:12,094 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 115f735ba18a41338a4a8cd9012cc819 2023-11-02 21:58:12,095 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family1/115f735ba18a41338a4a8cd9012cc819 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/115f735ba18a41338a4a8cd9012cc819 2023-11-02 21:58:12,113 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 115f735ba18a41338a4a8cd9012cc819 2023-11-02 21:58:12,114 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 44b67dc6c5556e2981535f424f1a8c58/family1 of 44b67dc6c5556e2981535f424f1a8c58 into 115f735ba18a41338a4a8cd9012cc819(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:58:12,114 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:58:12,114 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:58:12,114 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 44b67dc6c5556e2981535f424f1a8c58/family2 is initiating major compaction (all files) 2023-11-02 21:58:12,114 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:58:12,114 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:58:12,115 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 44b67dc6c5556e2981535f424f1a8c58/family2 in testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:12,115 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c3231fa10a5d488ba8909c1adb6369f3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c51beb510f014abc903a9973fe36a182, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/380b21a6943f4ee187f8d6757cb6981e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/ab79212fd81440a18a3959ae2d362175, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/d2cf3406dd0e44758592b9b179a6ca52] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp, totalSize=25.4 K 2023-11-02 21:58:12,116 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting c3231fa10a5d488ba8909c1adb6369f3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962281165 2023-11-02 21:58:12,116 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting c51beb510f014abc903a9973fe36a182, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962283213 2023-11-02 21:58:12,117 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 380b21a6943f4ee187f8d6757cb6981e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962284934 2023-11-02 21:58:12,117 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting ab79212fd81440a18a3959ae2d362175, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962286227 2023-11-02 21:58:12,118 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting d2cf3406dd0e44758592b9b179a6ca52, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:58:12,125 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 44b67dc6c5556e2981535f424f1a8c58#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:58:12,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/892f6346fe36438794dd43ae9a180072, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/63b0ddb3f36541698887cbb41da4f7e6, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7734015b7af24edfad0078313f845a53, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7219c3b699704dbea248159eb4ba882d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/e80b438eefe14072b66ffef1ee5beda0] to archive 2023-11-02 21:58:12,215 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:12,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/892f6346fe36438794dd43ae9a180072 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/892f6346fe36438794dd43ae9a180072 2023-11-02 21:58:12,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/63b0ddb3f36541698887cbb41da4f7e6 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/63b0ddb3f36541698887cbb41da4f7e6 2023-11-02 21:58:12,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7734015b7af24edfad0078313f845a53 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7734015b7af24edfad0078313f845a53 2023-11-02 21:58:12,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7219c3b699704dbea248159eb4ba882d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7219c3b699704dbea248159eb4ba882d 2023-11-02 21:58:12,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/e80b438eefe14072b66ffef1ee5beda0 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/e80b438eefe14072b66ffef1ee5beda0 2023-11-02 21:58:12,508 DEBUG [regionserver/jenkins-hbase12:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-02 21:58:12,531 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110232e4e5328385481e9dab246c3a3e6f46_del 2023-11-02 21:58:12,531 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110232e4e5328385481e9dab246c3a3e6f46_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023110232e4e5328385481e9dab246c3a3e6f46_del 2023-11-02 21:58:13,345 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4995df776cf4469e8499077cb1d6992b 2023-11-02 21:58:13,345 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/.tmp/family2/4995df776cf4469e8499077cb1d6992b as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/4995df776cf4469e8499077cb1d6992b 2023-11-02 21:58:13,348 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4995df776cf4469e8499077cb1d6992b 2023-11-02 21:58:13,349 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 44b67dc6c5556e2981535f424f1a8c58/family2 of 44b67dc6c5556e2981535f424f1a8c58 into 4995df776cf4469e8499077cb1d6992b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:58:13,349 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:58:13,349 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:58:13,349 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 5170ff45d70ceacf88cbe6280021175a/family1 is initiating major compaction (all files) 2023-11-02 21:58:13,349 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:58:13,349 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:58:13,349 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 5170ff45d70ceacf88cbe6280021175a/family1 in testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:13,350 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/24099511e0cf46bda452832a8aff882e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/7777fe7f56e84da69e2a6f3c287a47c7, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/c67c120690bf4606bc4139cba7fd68e8, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/48cba170a5644f1ca8b99fe77e8ae669, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/09142f42665f484aa1bbe7dbe010103b] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp, totalSize=27.1 K 2023-11-02 21:58:13,350 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 24099511e0cf46bda452832a8aff882e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962281165 2023-11-02 21:58:13,350 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 7777fe7f56e84da69e2a6f3c287a47c7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962283213 2023-11-02 21:58:13,351 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting c67c120690bf4606bc4139cba7fd68e8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962284934 2023-11-02 21:58:13,351 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 48cba170a5644f1ca8b99fe77e8ae669, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962286227 2023-11-02 21:58:13,351 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 09142f42665f484aa1bbe7dbe010103b, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:58:13,358 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 5170ff45d70ceacf88cbe6280021175a#family1#compaction#202 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:58:13,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c3231fa10a5d488ba8909c1adb6369f3, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c51beb510f014abc903a9973fe36a182, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/380b21a6943f4ee187f8d6757cb6981e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/ab79212fd81440a18a3959ae2d362175, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/d2cf3406dd0e44758592b9b179a6ca52] to archive 2023-11-02 21:58:13,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:13,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c3231fa10a5d488ba8909c1adb6369f3 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c3231fa10a5d488ba8909c1adb6369f3 2023-11-02 21:58:13,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c51beb510f014abc903a9973fe36a182 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/c51beb510f014abc903a9973fe36a182 2023-11-02 21:58:13,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/380b21a6943f4ee187f8d6757cb6981e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/380b21a6943f4ee187f8d6757cb6981e 2023-11-02 21:58:13,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/ab79212fd81440a18a3959ae2d362175 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/ab79212fd81440a18a3959ae2d362175 2023-11-02 21:58:13,411 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/d2cf3406dd0e44758592b9b179a6ca52 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family2/d2cf3406dd0e44758592b9b179a6ca52 2023-11-02 21:58:13,772 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-02 21:58:13,796 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110270c295df00e14857894ff0c4fbe1a70f_del 2023-11-02 21:58:13,796 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110270c295df00e14857894ff0c4fbe1a70f_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023110270c295df00e14857894ff0c4fbe1a70f_del 2023-11-02 21:58:14,644 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ecaed574bc340e8814661f33ded5632 2023-11-02 21:58:14,645 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family1/1ecaed574bc340e8814661f33ded5632 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/1ecaed574bc340e8814661f33ded5632 2023-11-02 21:58:14,663 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ecaed574bc340e8814661f33ded5632 2023-11-02 21:58:14,664 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5170ff45d70ceacf88cbe6280021175a/family1 of 5170ff45d70ceacf88cbe6280021175a into 1ecaed574bc340e8814661f33ded5632(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-02 21:58:14,664 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:58:14,664 DEBUG [Listener at localhost/34483] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-02 21:58:14,664 DEBUG [Listener at localhost/34483] regionserver.HStore(1912): 5170ff45d70ceacf88cbe6280021175a/family2 is initiating major compaction (all files) 2023-11-02 21:58:14,664 INFO [Listener at localhost/34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-02 21:58:14,664 INFO [Listener at localhost/34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-02 21:58:14,664 INFO [Listener at localhost/34483] regionserver.HRegion(2259): Starting compaction of 5170ff45d70ceacf88cbe6280021175a/family2 in testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:14,664 INFO [Listener at localhost/34483] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/7a07b14fa1ac48f59e853a5a43177cdf, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f97d81834f574c5e93bc0fe9702d938d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f6215d31285446798e4fb07aff326e72, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/d00c80dc8d934c128ae9c58064d6285b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/95d51ff460da4964b992792073268b6d] into tmpdir=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp, totalSize=25.4 K 2023-11-02 21:58:14,665 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 7a07b14fa1ac48f59e853a5a43177cdf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698962281165 2023-11-02 21:58:14,665 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting f97d81834f574c5e93bc0fe9702d938d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698962283213 2023-11-02 21:58:14,666 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting f6215d31285446798e4fb07aff326e72, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698962284934 2023-11-02 21:58:14,666 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting d00c80dc8d934c128ae9c58064d6285b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698962286227 2023-11-02 21:58:14,666 DEBUG [Listener at localhost/34483] compactions.Compactor(207): Compacting 95d51ff460da4964b992792073268b6d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-02 21:58:14,673 INFO [Listener at localhost/34483] throttle.PressureAwareThroughputController(145): 5170ff45d70ceacf88cbe6280021175a#family2#compaction#203 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-02 21:58:14,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/24099511e0cf46bda452832a8aff882e, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/7777fe7f56e84da69e2a6f3c287a47c7, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/c67c120690bf4606bc4139cba7fd68e8, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/48cba170a5644f1ca8b99fe77e8ae669, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/09142f42665f484aa1bbe7dbe010103b] to archive 2023-11-02 21:58:14,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:14,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/24099511e0cf46bda452832a8aff882e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/24099511e0cf46bda452832a8aff882e 2023-11-02 21:58:14,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/7777fe7f56e84da69e2a6f3c287a47c7 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/7777fe7f56e84da69e2a6f3c287a47c7 2023-11-02 21:58:14,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/c67c120690bf4606bc4139cba7fd68e8 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/c67c120690bf4606bc4139cba7fd68e8 2023-11-02 21:58:14,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/48cba170a5644f1ca8b99fe77e8ae669 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/48cba170a5644f1ca8b99fe77e8ae669 2023-11-02 21:58:14,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/09142f42665f484aa1bbe7dbe010103b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/09142f42665f484aa1bbe7dbe010103b 2023-11-02 21:58:15,038 DEBUG [regionserver/jenkins-hbase12:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-02 21:58:15,084 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311020c89d5c1a3ea4c3a9e2127371b2a1e1d_del 2023-11-02 21:58:15,085 INFO [Listener at localhost/34483] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311020c89d5c1a3ea4c3a9e2127371b2a1e1d_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311020c89d5c1a3ea4c3a9e2127371b2a1e1d_del 2023-11-02 21:58:15,499 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b39fd89991249988c556bbb7689ef3f 2023-11-02 21:58:15,500 DEBUG [Listener at localhost/34483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/.tmp/family2/7b39fd89991249988c556bbb7689ef3f as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/7b39fd89991249988c556bbb7689ef3f 2023-11-02 21:58:15,504 INFO [Listener at localhost/34483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b39fd89991249988c556bbb7689ef3f 2023-11-02 21:58:15,505 INFO [Listener at localhost/34483] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5170ff45d70ceacf88cbe6280021175a/family2 of 5170ff45d70ceacf88cbe6280021175a into 7b39fd89991249988c556bbb7689ef3f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-02 21:58:15,505 DEBUG [Listener at localhost/34483] regionserver.HRegion(2289): Compaction status journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:58:15,508 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:58:15,510 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:58:15,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/7a07b14fa1ac48f59e853a5a43177cdf, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f97d81834f574c5e93bc0fe9702d938d, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f6215d31285446798e4fb07aff326e72, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/d00c80dc8d934c128ae9c58064d6285b, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/95d51ff460da4964b992792073268b6d] to archive 2023-11-02 21:58:15,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:15,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/7a07b14fa1ac48f59e853a5a43177cdf to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/7a07b14fa1ac48f59e853a5a43177cdf 2023-11-02 21:58:15,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f97d81834f574c5e93bc0fe9702d938d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f97d81834f574c5e93bc0fe9702d938d 2023-11-02 21:58:15,514 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:58:15,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f6215d31285446798e4fb07aff326e72 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/f6215d31285446798e4fb07aff326e72 2023-11-02 21:58:15,515 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:58:15,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/d00c80dc8d934c128ae9c58064d6285b to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/d00c80dc8d934c128ae9c58064d6285b 2023-11-02 21:58:15,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/95d51ff460da4964b992792073268b6d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family2/95d51ff460da4964b992792073268b6d 2023-11-02 21:58:15,519 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40055] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x82\xB5\xC4O\xFD\xD1#\xE4tl\x9E\xA6\xC9\xAA\x17\x07"\x10W\x05\xA7\x0F1\x16\xB3\x80f\xC6\x7F\x16\x07\x06|\x07*\x10n4b\xB3\xD0C\xC4\x82n~P~\xB97k'2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-02 21:58:15,536 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-02 21:58:15,537 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-02 21:58:15,538 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:58:15,538 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698962895538 2023-11-02 21:58:15,538 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-02 21:58:15,839 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-02 21:58:15,859 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311022eb3c5bad2c943e9a7c00491aee5d915_del 2023-11-02 21:58:15,886 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110270c295df00e14857894ff0c4fbe1a70f_del 2023-11-02 21:58:15,909 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231102cb3d1358b4e643e58eaa79cdce62b97c_del 2023-11-02 21:58:15,909 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-02 21:58:15,909 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] zookeeper.ReadOnlyZKClient(139): Connect 0x2c55741a to 127.0.0.1:49550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-02 21:58:16,034 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1574ede5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-02 21:58:16,035 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231102 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-02 21:58:16,990 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231102f94951561d924ce2a6b1013aee6c350f to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231102f94951561d924ce2a6b1013aee6c350f 2023-11-02 21:58:16,991 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231102 table='testMajorCompactionFromAdmin' column='family1' 2023-11-02 21:58:17,002 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-02 21:58:17,004 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:41888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-02 21:58:17,013 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-02 21:58:17,015 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-02 21:58:17,045 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231102/family1/2ac5ad2723a64f7ab665a9397a778c56 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-02 21:58:17,046 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231102/family1/2ac5ad2723a64f7ab665a9397a778c56}] 2023-11-02 21:58:17,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231102/family1/2ac5ad2723a64f7ab665a9397a778c56 for inclusion in 44b67dc6c5556e2981535f424f1a8c58/family1 2023-11-02 21:58:17,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-02 21:58:17,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-02 21:58:17,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:58:17,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231102/family1/2ac5ad2723a64f7ab665a9397a778c56 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__c9oauackjbnvrstp6fhaqhu2p4uosm02sulcai8l1imh6hdd8gmgqfu2m0renher/family1/2ac5ad2723a64f7ab665a9397a778c56 2023-11-02 21:58:17,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__c9oauackjbnvrstp6fhaqhu2p4uosm02sulcai8l1imh6hdd8gmgqfu2m0renher/family1/2ac5ad2723a64f7ab665a9397a778c56 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7b631f5aa5b449959f11c48190526f37_SeqId_28_ 2023-11-02 21:58:17,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__c9oauackjbnvrstp6fhaqhu2p4uosm02sulcai8l1imh6hdd8gmgqfu2m0renher/family1/2ac5ad2723a64f7ab665a9397a778c56 into 44b67dc6c5556e2981535f424f1a8c58/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7b631f5aa5b449959f11c48190526f37_SeqId_28_ - updating store file list. 2023-11-02 21:58:17,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7b631f5aa5b449959f11c48190526f37_SeqId_28_ into 44b67dc6c5556e2981535f424f1a8c58/family1 2023-11-02 21:58:17,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__c9oauackjbnvrstp6fhaqhu2p4uosm02sulcai8l1imh6hdd8gmgqfu2m0renher/family1/2ac5ad2723a64f7ab665a9397a778c56 into 44b67dc6c5556e2981535f424f1a8c58/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/family1/7b631f5aa5b449959f11c48190526f37_SeqId_28_) 2023-11-02 21:58:17,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__c9oauackjbnvrstp6fhaqhu2p4uosm02sulcai8l1imh6hdd8gmgqfu2m0renher/family1/2ac5ad2723a64f7ab665a9397a778c56 2023-11-02 21:58:17,106 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231102 table='testMajorCompactionFromAdmin' column='family1' 2023-11-02 21:58:17,107 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:17,108 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110217cdf77a27d1480292844446e379a26c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110217cdf77a27d1480292844446e379a26c 2023-11-02 21:58:17,109 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110229cb3a8ac27d456891ba44f97adf0b2d to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110229cb3a8ac27d456891ba44f97adf0b2d 2023-11-02 21:58:17,110 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110249146eeae11d40909ccbaf03f18cf97a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110249146eeae11d40909ccbaf03f18cf97a 2023-11-02 21:58:17,111 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231102c8f0db367d2f41189585acbc469b4a9a to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231102c8f0db367d2f41189585acbc469b4a9a 2023-11-02 21:58:17,111 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-02 21:58:17,111 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231102' 2023-11-02 21:58:17,111 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231102 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-02 21:58:17,111 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231102 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-02 21:58:18,085 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231102b60a0b315dbf4e15b5f1a5f96a72805e to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102b60a0b315dbf4e15b5f1a5f96a72805e 2023-11-02 21:58:18,086 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231102 table='testMajorCompactionFromAdmin' column='family1' 2023-11-02 21:58:18,126 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231102/family1/c87dab8ec68e40a192ca37b42ce8e208 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-02 21:58:18,127 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231102/family1/c87dab8ec68e40a192ca37b42ce8e208}] 2023-11-02 21:58:18,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231102/family1/c87dab8ec68e40a192ca37b42ce8e208 for inclusion in 5170ff45d70ceacf88cbe6280021175a/family1 2023-11-02 21:58:18,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-02 21:58:18,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-02 21:58:18,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:58:18,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231102/family1/c87dab8ec68e40a192ca37b42ce8e208 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__6ua403s8nbpkgbatok7junj983pco9ne8cg5ve90pbp0deesnie1junbko8u1b0m/family1/c87dab8ec68e40a192ca37b42ce8e208 2023-11-02 21:58:18,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__6ua403s8nbpkgbatok7junj983pco9ne8cg5ve90pbp0deesnie1junbko8u1b0m/family1/c87dab8ec68e40a192ca37b42ce8e208 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/444e4227ab29469a83dcf256aeefaacc_SeqId_28_ 2023-11-02 21:58:18,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__6ua403s8nbpkgbatok7junj983pco9ne8cg5ve90pbp0deesnie1junbko8u1b0m/family1/c87dab8ec68e40a192ca37b42ce8e208 into 5170ff45d70ceacf88cbe6280021175a/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/444e4227ab29469a83dcf256aeefaacc_SeqId_28_ - updating store file list. 2023-11-02 21:58:18,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/444e4227ab29469a83dcf256aeefaacc_SeqId_28_ into 5170ff45d70ceacf88cbe6280021175a/family1 2023-11-02 21:58:18,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__6ua403s8nbpkgbatok7junj983pco9ne8cg5ve90pbp0deesnie1junbko8u1b0m/family1/c87dab8ec68e40a192ca37b42ce8e208 into 5170ff45d70ceacf88cbe6280021175a/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/family1/444e4227ab29469a83dcf256aeefaacc_SeqId_28_) 2023-11-02 21:58:18,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__6ua403s8nbpkgbatok7junj983pco9ne8cg5ve90pbp0deesnie1junbko8u1b0m/family1/c87dab8ec68e40a192ca37b42ce8e208 2023-11-02 21:58:18,176 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231102 table='testMajorCompactionFromAdmin' column='family1' 2023-11-02 21:58:18,176 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:18,177 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102495ed475d5794050a1f8ebf7d5637473 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102495ed475d5794050a1f8ebf7d5637473 2023-11-02 21:58:18,178 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102ac71da25013c47cd9e39db0eb26f22b1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102ac71da25013c47cd9e39db0eb26f22b1 2023-11-02 21:58:18,179 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102b90c56d32940461a84f31c3c34ac8ffb to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102b90c56d32940461a84f31c3c34ac8ffb 2023-11-02 21:58:18,180 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102e901d85ce8d54b81af71ed5b304cbf6c to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231102e901d85ce8d54b81af71ed5b304cbf6c 2023-11-02 21:58:18,180 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-02 21:58:18,180 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231102' 2023-11-02 21:58:18,181 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231102 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-02 21:58:18,181 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231102 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-02 21:58:19,177 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311027409fc85ede9429689ded8679e735ff2 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311027409fc85ede9429689ded8679e735ff2 2023-11-02 21:58:19,178 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231102 table='testMajorCompactionFromAdmin' column='family1' 2023-11-02 21:58:19,218 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231102/family1/ffd1fd8822294f33a06c4c3f2dce30b1 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-02 21:58:19,219 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd., hostname=jenkins-hbase12.apache.org,33583,1698962105160, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231102/family1/ffd1fd8822294f33a06c4c3f2dce30b1}] 2023-11-02 21:58:19,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(763): Validating hfile at hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231102/family1/ffd1fd8822294f33a06c4c3f2dce30b1 for inclusion in 011309148e779f051560204d0889ffdd/family1 2023-11-02 21:58:19,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-02 21:58:19,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(777): Region bounds: first= last=1 2023-11-02 21:58:19,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegion(2446): Flush status journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:58:19,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231102/family1/ffd1fd8822294f33a06c4c3f2dce30b1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__ptfh5psh6pmj3ga30lfcl3sas7ma8suavc51qco3qdtle1m5tcrk9d48bl49hq8n/family1/ffd1fd8822294f33a06c4c3f2dce30b1 2023-11-02 21:58:19,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__ptfh5psh6pmj3ga30lfcl3sas7ma8suavc51qco3qdtle1m5tcrk9d48bl49hq8n/family1/ffd1fd8822294f33a06c4c3f2dce30b1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/fb68b1afa30f43708375c7f8522d1c7e_SeqId_28_ 2023-11-02 21:58:19,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(849): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__ptfh5psh6pmj3ga30lfcl3sas7ma8suavc51qco3qdtle1m5tcrk9d48bl49hq8n/family1/ffd1fd8822294f33a06c4c3f2dce30b1 into 011309148e779f051560204d0889ffdd/family1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/fb68b1afa30f43708375c7f8522d1c7e_SeqId_28_ - updating store file list. 2023-11-02 21:58:19,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(882): Loaded HFile hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/fb68b1afa30f43708375c7f8522d1c7e_SeqId_28_ into 011309148e779f051560204d0889ffdd/family1 2023-11-02 21:58:19,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.HStore(855): Successfully loaded hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__ptfh5psh6pmj3ga30lfcl3sas7ma8suavc51qco3qdtle1m5tcrk9d48bl49hq8n/family1/ffd1fd8822294f33a06c4c3f2dce30b1 into 011309148e779f051560204d0889ffdd/family1 (new location: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/family1/fb68b1afa30f43708375c7f8522d1c7e_SeqId_28_) 2023-11-02 21:58:19,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33583] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/staging/jenkins__testMajorCompactionFromAdmin__ptfh5psh6pmj3ga30lfcl3sas7ma8suavc51qco3qdtle1m5tcrk9d48bl49hq8n/family1/ffd1fd8822294f33a06c4c3f2dce30b1 2023-11-02 21:58:19,266 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231102 table='testMajorCompactionFromAdmin' column='family1' 2023-11-02 21:58:19,267 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:19,268 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311021c34e2eb69fa4989a705bb6eb6491121 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311021c34e2eb69fa4989a705bb6eb6491121 2023-11-02 21:58:19,268 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110232ce179c51374422ba872587cf148477 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110232ce179c51374422ba872587cf148477 2023-11-02 21:58:19,269 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231102b14bfc47c07f459596cde8b389d625b5 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231102b14bfc47c07f459596cde8b389d625b5 2023-11-02 21:58:19,270 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231102ca3198b7a9cc423ba1841368c06a5dc1 to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231102ca3198b7a9cc423ba1841368c06a5dc1 2023-11-02 21:58:19,270 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-02 21:58:19,270 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231102' 2023-11-02 21:58:19,271 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231102 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-02 21:58:19,271 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-02 21:58:19,271 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-02 21:58:19,271 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311022eb3c5bad2c943e9a7c00491aee5d915_del] 2023-11-02 21:58:19,271 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:19,274 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311022eb3c5bad2c943e9a7c00491aee5d915_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311022eb3c5bad2c943e9a7c00491aee5d915_del 2023-11-02 21:58:19,274 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-02 21:58:19,274 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023110270c295df00e14857894ff0c4fbe1a70f_del] 2023-11-02 21:58:19,275 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:19,276 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023110270c295df00e14857894ff0c4fbe1a70f_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023110270c295df00e14857894ff0c4fbe1a70f_del 2023-11-02 21:58:19,276 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-02 21:58:19,276 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231102cb3d1358b4e643e58eaa79cdce62b97c_del] 2023-11-02 21:58:19,276 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] backup.HFileArchiver(360): Archiving compacted files. 2023-11-02 21:58:19,278 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231102cb3d1358b4e643e58eaa79cdce62b97c_del to hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231102cb3d1358b4e643e58eaa79cdce62b97c_del 2023-11-02 21:58:19,278 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-02 21:58:19,278 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1698962110257] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-02 21:58:19,279 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-02 21:58:19,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.7430 sec 2023-11-02 21:58:19,299 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:58:19,301 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:58:19,304 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-02 21:58:19,305 DEBUG [Listener at localhost/34483] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-02 21:58:19,308 INFO [Listener at localhost/34483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-02 21:58:19,343 INFO [Listener at localhost/34483] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 256), OpenFileDescriptor=672 (was 673), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=136 (was 152), ProcessCount=172 (was 172), AvailableMemoryMB=236 (was 239) 2023-11-02 21:58:19,344 DEBUG [Listener at localhost/34483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75a6f40a to 127.0.0.1:49550 2023-11-02 21:58:19,344 DEBUG [Listener at localhost/34483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:58:19,344 INFO [Listener at localhost/34483] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-02 21:58:19,344 INFO [Listener at localhost/34483] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-02 21:58:19,344 DEBUG [Listener at localhost/34483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0939b377 to 127.0.0.1:49550 2023-11-02 21:58:19,344 DEBUG [Listener at localhost/34483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:58:19,344 DEBUG [Listener at localhost/34483] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-02 21:58:19,345 DEBUG [Listener at localhost/34483] util.JVMClusterUtil(257): Found active master hash=1506211126, stopped=false 2023-11-02 21:58:19,345 INFO [Listener at localhost/34483] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase12.apache.org,40055,1698962103892 2023-11-02 21:58:19,431 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-02 21:58:19,431 INFO [Listener at localhost/34483] procedure2.ProcedureExecutor(628): Stopping 2023-11-02 21:58:19,431 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-02 21:58:19,432 DEBUG [Listener at localhost/34483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25337e57 to 127.0.0.1:49550 2023-11-02 21:58:19,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-02 21:58:19,432 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-02 21:58:19,432 DEBUG [Listener at localhost/34483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:58:19,432 INFO [Listener at localhost/34483] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase12.apache.org,33583,1698962105160' ***** 2023-11-02 21:58:19,432 INFO [Listener at localhost/34483] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-02 21:58:19,432 INFO [RS:0;jenkins-hbase12:33583] regionserver.HeapMemoryManager(220): Stopping 2023-11-02 21:58:19,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-02 21:58:19,433 INFO [RS:0;jenkins-hbase12:33583] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-02 21:58:19,433 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-02 21:58:19,433 INFO [RS:0;jenkins-hbase12:33583] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-02 21:58:19,433 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 78fa04c7b43844795d0ffcceeb0aa641 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:58:19,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 78fa04c7b43844795d0ffcceeb0aa641, disabling compactions & flushes 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for a60f818b223a39e20a92d5ad84ca38d8 2023-11-02 21:58:19,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 245a468c597d21bd747b336f9fe7855c 2023-11-02 21:58:19,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 8868577134076e1bd90135190764517a 2023-11-02 21:58:19,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. after waiting 0 ms 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 8e9e4ab39f8ae69643af213a16c22de1 2023-11-02 21:58:19,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 173673ee4b2ff5cef47c017ea56e3191 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for c8c87357778eb61d30f523cb6ae1f5a8 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 011309148e779f051560204d0889ffdd 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 8cb793f0a9b02d274d44d3bfb0a21f4c 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 3ae88ad7788665b920f0d58b6cd6fbe4 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 164bf322b8449fbcab3e8d323d1a1b84 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for cf901ed3d958e22b4fac1a5a9cd0edc6 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 454cd05942026638919fcedce9e68ca5 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 44b67dc6c5556e2981535f424f1a8c58 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 5170ff45d70ceacf88cbe6280021175a 2023-11-02 21:58:19,434 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for d124ffa7fff84dce506beb288e8a5590 2023-11-02 21:58:19,435 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 2fbdea9497438f69e6da4fc12f119a9b 2023-11-02 21:58:19,435 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 12a2ddbbcd3cbf817e3db2e855e7a014 2023-11-02 21:58:19,435 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1144): stopping server jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:19,435 DEBUG [RS:0;jenkins-hbase12:33583] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x457d166a to 127.0.0.1:49550 2023-11-02 21:58:19,435 DEBUG [RS:0;jenkins-hbase12:33583] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:58:19,435 INFO [RS:0;jenkins-hbase12:33583] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-02 21:58:19,435 INFO [RS:0;jenkins-hbase12:33583] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-02 21:58:19,435 INFO [RS:0;jenkins-hbase12:33583] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-02 21:58:19,435 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-02 21:58:19,440 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-02 21:58:19,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-02 21:58:19,440 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-02 21:58:19,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-02 21:58:19,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-02 21:58:19,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-02 21:58:19,440 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-11-02 21:58:19,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78fa04c7b43844795d0ffcceeb0aa641/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-02 21:58:19,441 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1504): Waiting on 011309148e779f051560204d0889ffdd, 12a2ddbbcd3cbf817e3db2e855e7a014, 1588230740, 164bf322b8449fbcab3e8d323d1a1b84, 173673ee4b2ff5cef47c017ea56e3191, 245a468c597d21bd747b336f9fe7855c, 2fbdea9497438f69e6da4fc12f119a9b, 3ae88ad7788665b920f0d58b6cd6fbe4, 44b67dc6c5556e2981535f424f1a8c58, 454cd05942026638919fcedce9e68ca5, 5170ff45d70ceacf88cbe6280021175a, 78fa04c7b43844795d0ffcceeb0aa641, 8868577134076e1bd90135190764517a, 8cb793f0a9b02d274d44d3bfb0a21f4c, 8e9e4ab39f8ae69643af213a16c22de1, a60f818b223a39e20a92d5ad84ca38d8, c8c87357778eb61d30f523cb6ae1f5a8, cf901ed3d958e22b4fac1a5a9cd0edc6, d124ffa7fff84dce506beb288e8a5590, dc68987b77885ebafbaa8da888a20bd0, e92d97a5fce63a593b6e19d1ce049ed1 2023-11-02 21:58:19,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:58:19,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 78fa04c7b43844795d0ffcceeb0aa641: 2023-11-02 21:58:19,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698962110508.78fa04c7b43844795d0ffcceeb0aa641. 2023-11-02 21:58:19,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing e92d97a5fce63a593b6e19d1ce049ed1, disabling compactions & flushes 2023-11-02 21:58:19,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:58:19,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:58:19,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. after waiting 0 ms 2023-11-02 21:58:19,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:58:19,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/e92d97a5fce63a593b6e19d1ce049ed1/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-02 21:58:19,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:58:19,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for e92d97a5fce63a593b6e19d1ce049ed1: 2023-11-02 21:58:19,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1698962217357.e92d97a5fce63a593b6e19d1ce049ed1. 2023-11-02 21:58:19,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing a60f818b223a39e20a92d5ad84ca38d8, disabling compactions & flushes 2023-11-02 21:58:19,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:58:19,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:58:19,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. after waiting 0 ms 2023-11-02 21:58:19,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:58:19,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/a60f818b223a39e20a92d5ad84ca38d8/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-02 21:58:19,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:58:19,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for a60f818b223a39e20a92d5ad84ca38d8: 2023-11-02 21:58:19,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1698962156553.a60f818b223a39e20a92d5ad84ca38d8. 2023-11-02 21:58:19,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 245a468c597d21bd747b336f9fe7855c, disabling compactions & flushes 2023-11-02 21:58:19,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:58:19,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:58:19,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. after waiting 0 ms 2023-11-02 21:58:19,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:58:19,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/245a468c597d21bd747b336f9fe7855c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-02 21:58:19,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:58:19,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 245a468c597d21bd747b336f9fe7855c: 2023-11-02 21:58:19,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1698962156553.245a468c597d21bd747b336f9fe7855c. 2023-11-02 21:58:19,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 8868577134076e1bd90135190764517a, disabling compactions & flushes 2023-11-02 21:58:19,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:58:19,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:58:19,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. after waiting 0 ms 2023-11-02 21:58:19,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:58:19,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/8868577134076e1bd90135190764517a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-02 21:58:19,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:58:19,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 8868577134076e1bd90135190764517a: 2023-11-02 21:58:19,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1698962245536.8868577134076e1bd90135190764517a. 2023-11-02 21:58:19,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 8e9e4ab39f8ae69643af213a16c22de1, disabling compactions & flushes 2023-11-02 21:58:19,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:58:19,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:58:19,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. after waiting 0 ms 2023-11-02 21:58:19,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:58:19,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithMonthlyPolicy/8e9e4ab39f8ae69643af213a16c22de1/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-02 21:58:19,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:58:19,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 8e9e4ab39f8ae69643af213a16c22de1: 2023-11-02 21:58:19,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1698962126080.8e9e4ab39f8ae69643af213a16c22de1. 2023-11-02 21:58:19,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 173673ee4b2ff5cef47c017ea56e3191, disabling compactions & flushes 2023-11-02 21:58:19,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:58:19,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:58:19,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. after waiting 0 ms 2023-11-02 21:58:19,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:58:19,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/173673ee4b2ff5cef47c017ea56e3191/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-02 21:58:19,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:58:19,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 173673ee4b2ff5cef47c017ea56e3191: 2023-11-02 21:58:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1698962245536.173673ee4b2ff5cef47c017ea56e3191. 2023-11-02 21:58:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing dc68987b77885ebafbaa8da888a20bd0, disabling compactions & flushes 2023-11-02 21:58:19,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:58:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:58:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. after waiting 0 ms 2023-11-02 21:58:19,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:58:19,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2745): Flushing dc68987b77885ebafbaa8da888a20bd0 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-02 21:58:19,493 INFO [regionserver/jenkins-hbase12:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-02 21:58:19,504 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-02 21:58:19,641 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1504): Waiting on 011309148e779f051560204d0889ffdd, 12a2ddbbcd3cbf817e3db2e855e7a014, 1588230740, 164bf322b8449fbcab3e8d323d1a1b84, 2fbdea9497438f69e6da4fc12f119a9b, 3ae88ad7788665b920f0d58b6cd6fbe4, 44b67dc6c5556e2981535f424f1a8c58, 454cd05942026638919fcedce9e68ca5, 5170ff45d70ceacf88cbe6280021175a, 8cb793f0a9b02d274d44d3bfb0a21f4c, c8c87357778eb61d30f523cb6ae1f5a8, cf901ed3d958e22b4fac1a5a9cd0edc6, d124ffa7fff84dce506beb288e8a5590, dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:58:19,841 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1504): Waiting on 011309148e779f051560204d0889ffdd, 12a2ddbbcd3cbf817e3db2e855e7a014, 1588230740, 164bf322b8449fbcab3e8d323d1a1b84, 2fbdea9497438f69e6da4fc12f119a9b, 3ae88ad7788665b920f0d58b6cd6fbe4, 44b67dc6c5556e2981535f424f1a8c58, 454cd05942026638919fcedce9e68ca5, 5170ff45d70ceacf88cbe6280021175a, 8cb793f0a9b02d274d44d3bfb0a21f4c, c8c87357778eb61d30f523cb6ae1f5a8, cf901ed3d958e22b4fac1a5a9cd0edc6, d124ffa7fff84dce506beb288e8a5590, dc68987b77885ebafbaa8da888a20bd0 2023-11-02 21:58:19,852 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/.tmp/info/332f39c1afaf46299c06c2757a1347ae 2023-11-02 21:58:19,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 332f39c1afaf46299c06c2757a1347ae 2023-11-02 21:58:19,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0/.tmp/info/19651d63a24b47e2b17db50fa18a31d9 2023-11-02 21:58:19,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0/.tmp/info/19651d63a24b47e2b17db50fa18a31d9 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0/info/19651d63a24b47e2b17db50fa18a31d9 2023-11-02 21:58:19,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0/info/19651d63a24b47e2b17db50fa18a31d9, entries=3, sequenceid=7, filesize=4.8 K 2023-11-02 21:58:19,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for dc68987b77885ebafbaa8da888a20bd0 in 416ms, sequenceid=7, compaction requested=false 2023-11-02 21:58:19,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/namespace/dc68987b77885ebafbaa8da888a20bd0/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-02 21:58:19,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:58:19,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for dc68987b77885ebafbaa8da888a20bd0: 2023-11-02 21:58:19,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1698962108659.dc68987b77885ebafbaa8da888a20bd0. 2023-11-02 21:58:19,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing c8c87357778eb61d30f523cb6ae1f5a8, disabling compactions & flushes 2023-11-02 21:58:19,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:58:19,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:58:19,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. after waiting 0 ms 2023-11-02 21:58:19,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:58:19,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithWeeklyPolicy/c8c87357778eb61d30f523cb6ae1f5a8/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-02 21:58:19,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:58:19,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for c8c87357778eb61d30f523cb6ae1f5a8: 2023-11-02 21:58:19,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1698962140774.c8c87357778eb61d30f523cb6ae1f5a8. 2023-11-02 21:58:19,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 011309148e779f051560204d0889ffdd, disabling compactions & flushes 2023-11-02 21:58:19,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:19,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:19,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. after waiting 0 ms 2023-11-02 21:58:19,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:19,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/011309148e779f051560204d0889ffdd/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-02 21:58:19,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:19,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 011309148e779f051560204d0889ffdd: 2023-11-02 21:58:19,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1698962279019.011309148e779f051560204d0889ffdd. 2023-11-02 21:58:19,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 8cb793f0a9b02d274d44d3bfb0a21f4c, disabling compactions & flushes 2023-11-02 21:58:19,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:58:19,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:58:19,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. after waiting 0 ms 2023-11-02 21:58:19,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:58:19,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/8cb793f0a9b02d274d44d3bfb0a21f4c/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-02 21:58:19,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:58:19,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 8cb793f0a9b02d274d44d3bfb0a21f4c: 2023-11-02 21:58:19,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1698962217357.8cb793f0a9b02d274d44d3bfb0a21f4c. 2023-11-02 21:58:19,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 3ae88ad7788665b920f0d58b6cd6fbe4, disabling compactions & flushes 2023-11-02 21:58:19,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:58:19,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:58:19,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. after waiting 0 ms 2023-11-02 21:58:19,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:58:19,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/3ae88ad7788665b920f0d58b6cd6fbe4/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-02 21:58:19,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:58:19,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 3ae88ad7788665b920f0d58b6cd6fbe4: 2023-11-02 21:58:19,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698962194154.3ae88ad7788665b920f0d58b6cd6fbe4. 2023-11-02 21:58:19,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 164bf322b8449fbcab3e8d323d1a1b84, disabling compactions & flushes 2023-11-02 21:58:19,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:58:19,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:58:19,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. after waiting 0 ms 2023-11-02 21:58:19,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:58:19,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMinorCompactionWithMonthlyPolicy/164bf322b8449fbcab3e8d323d1a1b84/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-02 21:58:19,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:58:19,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 164bf322b8449fbcab3e8d323d1a1b84: 2023-11-02 21:58:19,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1698962265206.164bf322b8449fbcab3e8d323d1a1b84. 2023-11-02 21:58:19,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing cf901ed3d958e22b4fac1a5a9cd0edc6, disabling compactions & flushes 2023-11-02 21:58:19,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:58:19,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:58:19,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. after waiting 0 ms 2023-11-02 21:58:19,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:58:19,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyPolicy/cf901ed3d958e22b4fac1a5a9cd0edc6/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-02 21:58:19,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:58:19,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for cf901ed3d958e22b4fac1a5a9cd0edc6: 2023-11-02 21:58:19,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1698962161634.cf901ed3d958e22b4fac1a5a9cd0edc6. 2023-11-02 21:58:19,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 454cd05942026638919fcedce9e68ca5, disabling compactions & flushes 2023-11-02 21:58:19,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:58:19,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:58:19,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. after waiting 0 ms 2023-11-02 21:58:19,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:58:19,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testCompactionWithHFileLink/454cd05942026638919fcedce9e68ca5/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-02 21:58:19,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:58:19,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 454cd05942026638919fcedce9e68ca5: 2023-11-02 21:58:19,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1698962217357.454cd05942026638919fcedce9e68ca5. 2023-11-02 21:58:19,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 44b67dc6c5556e2981535f424f1a8c58, disabling compactions & flushes 2023-11-02 21:58:19,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:19,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:19,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. after waiting 0 ms 2023-11-02 21:58:19,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:19,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/44b67dc6c5556e2981535f424f1a8c58/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-02 21:58:19,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:19,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 44b67dc6c5556e2981535f424f1a8c58: 2023-11-02 21:58:19,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1698962279019.44b67dc6c5556e2981535f424f1a8c58. 2023-11-02 21:58:19,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 5170ff45d70ceacf88cbe6280021175a, disabling compactions & flushes 2023-11-02 21:58:19,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:19,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:19,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. after waiting 0 ms 2023-11-02 21:58:19,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:19,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionFromAdmin/5170ff45d70ceacf88cbe6280021175a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-02 21:58:19,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:19,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 5170ff45d70ceacf88cbe6280021175a: 2023-11-02 21:58:19,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1698962279019.5170ff45d70ceacf88cbe6280021175a. 2023-11-02 21:58:19,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing d124ffa7fff84dce506beb288e8a5590, disabling compactions & flushes 2023-11-02 21:58:19,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:58:19,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:58:19,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. after waiting 0 ms 2023-11-02 21:58:19,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:58:19,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/ns/testMinorCompaction/d124ffa7fff84dce506beb288e8a5590/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-02 21:58:19,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:58:19,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for d124ffa7fff84dce506beb288e8a5590: 2023-11-02 21:58:19,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1698962245536.d124ffa7fff84dce506beb288e8a5590. 2023-11-02 21:58:19,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 2fbdea9497438f69e6da4fc12f119a9b, disabling compactions & flushes 2023-11-02 21:58:19,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:58:19,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:58:19,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. after waiting 0 ms 2023-11-02 21:58:19,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:58:19,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testScannerOnBulkLoadRefHFiles/2fbdea9497438f69e6da4fc12f119a9b/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-02 21:58:19,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:58:19,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 2fbdea9497438f69e6da4fc12f119a9b: 2023-11-02 21:58:19,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1698962156553.2fbdea9497438f69e6da4fc12f119a9b. 2023-11-02 21:58:19,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1604): Closing 12a2ddbbcd3cbf817e3db2e855e7a014, disabling compactions & flushes 2023-11-02 21:58:19,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:58:19,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:58:19,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. after waiting 0 ms 2023-11-02 21:58:19,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:58:19,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/12a2ddbbcd3cbf817e3db2e855e7a014/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-02 21:58:19,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:58:19,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 12a2ddbbcd3cbf817e3db2e855e7a014: 2023-11-02 21:58:19,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698962176682.12a2ddbbcd3cbf817e3db2e855e7a014. 2023-11-02 21:58:20,042 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-02 21:58:20,242 DEBUG [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-02 21:58:20,265 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/.tmp/rep_barrier/c25190f7d20a49f9a676a96bf335b7da 2023-11-02 21:58:20,270 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c25190f7d20a49f9a676a96bf335b7da 2023-11-02 21:58:20,278 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/.tmp/table/aaa9184f9433420d902177c81b799bc1 2023-11-02 21:58:20,283 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aaa9184f9433420d902177c81b799bc1 2023-11-02 21:58:20,284 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/.tmp/info/332f39c1afaf46299c06c2757a1347ae as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/info/332f39c1afaf46299c06c2757a1347ae 2023-11-02 21:58:20,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 332f39c1afaf46299c06c2757a1347ae 2023-11-02 21:58:20,289 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/info/332f39c1afaf46299c06c2757a1347ae, entries=226, sequenceid=130, filesize=37.9 K 2023-11-02 21:58:20,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/.tmp/rep_barrier/c25190f7d20a49f9a676a96bf335b7da as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/rep_barrier/c25190f7d20a49f9a676a96bf335b7da 2023-11-02 21:58:20,294 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c25190f7d20a49f9a676a96bf335b7da 2023-11-02 21:58:20,294 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/rep_barrier/c25190f7d20a49f9a676a96bf335b7da, entries=1, sequenceid=130, filesize=5.0 K 2023-11-02 21:58:20,295 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/.tmp/table/aaa9184f9433420d902177c81b799bc1 as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/table/aaa9184f9433420d902177c81b799bc1 2023-11-02 21:58:20,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aaa9184f9433420d902177c81b799bc1 2023-11-02 21:58:20,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/table/aaa9184f9433420d902177c81b799bc1, entries=27, sequenceid=130, filesize=6.6 K 2023-11-02 21:58:20,302 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 862ms, sequenceid=130, compaction requested=false 2023-11-02 21:58:20,312 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-02 21:58:20,313 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-02 21:58:20,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-02 21:58:20,313 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-02 21:58:20,313 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-02 21:58:20,425 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-02 21:58:20,425 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-02 21:58:20,442 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1170): stopping server jenkins-hbase12.apache.org,33583,1698962105160; all regions closed. 2023-11-02 21:58:20,457 DEBUG [RS:0;jenkins-hbase12:33583] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/oldWALs 2023-11-02 21:58:20,457 INFO [RS:0;jenkins-hbase12:33583] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase12.apache.org%2C33583%2C1698962105160.meta:.meta(num 1698962108211) 2023-11-02 21:58:20,471 DEBUG [RS:0;jenkins-hbase12:33583] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/oldWALs 2023-11-02 21:58:20,471 INFO [RS:0;jenkins-hbase12:33583] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase12.apache.org%2C33583%2C1698962105160:(num 1698962107577) 2023-11-02 21:58:20,471 DEBUG [RS:0;jenkins-hbase12:33583] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:58:20,471 INFO [RS:0;jenkins-hbase12:33583] regionserver.LeaseManager(133): Closed leases 2023-11-02 21:58:20,471 INFO [RS:0;jenkins-hbase12:33583] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase12:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-02 21:58:20,471 INFO [regionserver/jenkins-hbase12:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-02 21:58:20,472 INFO [RS:0;jenkins-hbase12:33583] ipc.NettyRpcServer(158): Stopping server on /136.243.104.168:33583 2023-11-02 21:58:20,589 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-02 21:58:20,589 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase12.apache.org,33583,1698962105160 2023-11-02 21:58:20,589 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-02 21:58:20,590 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase12.apache.org,33583,1698962105160] 2023-11-02 21:58:20,590 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase12.apache.org,33583,1698962105160; numProcessing=1 2023-11-02 21:58:20,610 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase12.apache.org,33583,1698962105160 already deleted, retry=false 2023-11-02 21:58:20,610 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase12.apache.org,33583,1698962105160 expired; onlineServers=0 2023-11-02 21:58:20,610 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase12.apache.org,40055,1698962103892' ***** 2023-11-02 21:58:20,610 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-02 21:58:20,611 DEBUG [M:0;jenkins-hbase12:40055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18fbff0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase12.apache.org/136.243.104.168:0 2023-11-02 21:58:20,611 INFO [M:0;jenkins-hbase12:40055] regionserver.HRegionServer(1144): stopping server jenkins-hbase12.apache.org,40055,1698962103892 2023-11-02 21:58:20,611 INFO [M:0;jenkins-hbase12:40055] regionserver.HRegionServer(1170): stopping server jenkins-hbase12.apache.org,40055,1698962103892; all regions closed. 2023-11-02 21:58:20,611 DEBUG [M:0;jenkins-hbase12:40055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-02 21:58:20,612 DEBUG [M:0;jenkins-hbase12:40055] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-02 21:58:20,612 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-02 21:58:20,612 DEBUG [M:0;jenkins-hbase12:40055] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-02 21:58:20,612 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1698962107241] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1698962107241,5,FailOnTimeoutGroup] 2023-11-02 21:58:20,612 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1698962107244] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1698962107244,5,FailOnTimeoutGroup] 2023-11-02 21:58:20,612 INFO [M:0;jenkins-hbase12:40055] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-02 21:58:20,612 INFO [M:0;jenkins-hbase12:40055] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-02 21:58:20,612 INFO [M:0;jenkins-hbase12:40055] hbase.ChoreService(369): Chore service for: master/jenkins-hbase12:0 had [] on shutdown 2023-11-02 21:58:20,613 DEBUG [M:0;jenkins-hbase12:40055] master.HMaster(1512): Stopping service threads 2023-11-02 21:58:20,613 INFO [M:0;jenkins-hbase12:40055] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-02 21:58:20,613 ERROR [M:0;jenkins-hbase12:40055] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-02 21:58:20,613 INFO [M:0;jenkins-hbase12:40055] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-02 21:58:20,614 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-02 21:58:20,621 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-02 21:58:20,621 DEBUG [M:0;jenkins-hbase12:40055] zookeeper.ZKUtil(398): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-02 21:58:20,621 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-02 21:58:20,621 WARN [M:0;jenkins-hbase12:40055] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-02 21:58:20,621 INFO [M:0;jenkins-hbase12:40055] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-02 21:58:20,621 INFO [M:0;jenkins-hbase12:40055] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-02 21:58:20,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-02 21:58:20,621 DEBUG [M:0;jenkins-hbase12:40055] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-02 21:58:20,622 INFO [M:0;jenkins-hbase12:40055] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-02 21:58:20,622 DEBUG [M:0;jenkins-hbase12:40055] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-02 21:58:20,622 DEBUG [M:0;jenkins-hbase12:40055] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-02 21:58:20,622 DEBUG [M:0;jenkins-hbase12:40055] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-02 21:58:20,622 INFO [M:0;jenkins-hbase12:40055] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.53 KB heapSize=599.78 KB 2023-11-02 21:58:20,700 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-02 21:58:20,700 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): regionserver:33583-0x100cf325d340001, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-02 21:58:20,700 INFO [RS:0;jenkins-hbase12:33583] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase12.apache.org,33583,1698962105160; zookeeper connection closed. 2023-11-02 21:58:20,700 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3fea680c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3fea680c 2023-11-02 21:58:20,701 INFO [Listener at localhost/34483] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-02 21:58:21,030 INFO [M:0;jenkins-hbase12:40055] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.53 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9cc86dc72ff840b485bd1be984a89e8a 2023-11-02 21:58:21,035 INFO [M:0;jenkins-hbase12:40055] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9cc86dc72ff840b485bd1be984a89e8a 2023-11-02 21:58:21,037 DEBUG [M:0;jenkins-hbase12:40055] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9cc86dc72ff840b485bd1be984a89e8a as hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9cc86dc72ff840b485bd1be984a89e8a 2023-11-02 21:58:21,043 INFO [M:0;jenkins-hbase12:40055] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9cc86dc72ff840b485bd1be984a89e8a 2023-11-02 21:58:21,043 INFO [M:0;jenkins-hbase12:40055] regionserver.HStore(1080): Added hdfs://localhost:34899/user/jenkins/test-data/638b5b4b-3829-4cc2-a146-573eac850c16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9cc86dc72ff840b485bd1be984a89e8a, entries=123, sequenceid=1011, filesize=33.3 K 2023-11-02 21:58:21,044 INFO [M:0;jenkins-hbase12:40055] regionserver.HRegion(2948): Finished flush of dataSize ~513.53 KB/525852, heapSize ~599.77 KB/614160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 422ms, sequenceid=1011, compaction requested=false 2023-11-02 21:58:21,044 INFO [M:0;jenkins-hbase12:40055] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-02 21:58:21,044 DEBUG [M:0;jenkins-hbase12:40055] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-02 21:58:21,047 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-02 21:58:21,047 INFO [M:0;jenkins-hbase12:40055] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-02 21:58:21,048 INFO [M:0;jenkins-hbase12:40055] ipc.NettyRpcServer(158): Stopping server on /136.243.104.168:40055 2023-11-02 21:58:21,057 DEBUG [M:0;jenkins-hbase12:40055] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase12.apache.org,40055,1698962103892 already deleted, retry=false 2023-11-02 21:58:21,168 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-02 21:58:21,168 DEBUG [Listener at localhost/34483-EventThread] zookeeper.ZKWatcher(600): master:40055-0x100cf325d340000, quorum=127.0.0.1:49550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-02 21:58:21,168 INFO [M:0;jenkins-hbase12:40055] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase12.apache.org,40055,1698962103892; zookeeper connection closed. 2023-11-02 21:58:21,170 WARN [Listener at localhost/34483] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-02 21:58:21,198 INFO [Listener at localhost/34483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-02 21:58:21,307 WARN [BP-263132594-136.243.104.168-1698962100113 heartbeating to localhost/127.0.0.1:34899] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-02 21:58:21,307 WARN [BP-263132594-136.243.104.168-1698962100113 heartbeating to localhost/127.0.0.1:34899] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-263132594-136.243.104.168-1698962100113 (Datanode Uuid dd8357ca-4dc9-4c2d-b9a4-101cc4cce1ae) service to localhost/127.0.0.1:34899 2023-11-02 21:58:21,309 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/cluster_447f0e9b-ccb8-1ecb-10d1-87f66cbaf59a/dfs/data/data1/current/BP-263132594-136.243.104.168-1698962100113] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-02 21:58:21,310 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/061aea52-d9a9-95dd-aa3a-73fd957e92ed/cluster_447f0e9b-ccb8-1ecb-10d1-87f66cbaf59a/dfs/data/data2/current/BP-263132594-136.243.104.168-1698962100113] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-02 21:58:21,331 INFO [Listener at localhost/34483] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-02 21:58:21,463 INFO [Listener at localhost/34483] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-02 21:58:21,541 INFO [Listener at localhost/34483] hbase.HBaseTestingUtility(1293): Minicluster is down