2023-10-31 05:52:39,773 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-10-31 05:52:39,962 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74 2023-10-31 05:52:39,976 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-31 05:52:39,977 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/cluster_8ab50123-55f1-194a-5eb5-80cabe53771a, deleteOnExit=true 2023-10-31 05:52:39,977 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-31 05:52:39,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/test.cache.data in system properties and HBase conf 2023-10-31 05:52:39,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/hadoop.tmp.dir in system properties and HBase conf 2023-10-31 05:52:39,979 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/hadoop.log.dir in system properties and HBase conf 2023-10-31 05:52:39,980 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-31 05:52:39,980 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-31 05:52:39,980 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-31 05:52:40,090 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-31 05:52:40,444 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-31 05:52:40,448 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-31 05:52:40,449 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-31 05:52:40,449 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-31 05:52:40,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-31 05:52:40,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-31 05:52:40,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-31 05:52:40,450 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-31 05:52:40,451 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-31 05:52:40,451 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-31 05:52:40,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/nfs.dump.dir in system properties and HBase conf 2023-10-31 05:52:40,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/java.io.tmpdir in system properties and HBase conf 2023-10-31 05:52:40,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-31 05:52:40,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-31 05:52:40,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-31 05:52:41,010 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-31 05:52:41,015 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-31 05:52:41,283 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-31 05:52:41,465 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-31 05:52:41,480 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-31 05:52:41,514 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-31 05:52:41,546 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/java.io.tmpdir/Jetty_localhost_43227_hdfs____.b4n7su/webapp 2023-10-31 05:52:41,674 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43227 2023-10-31 05:52:41,681 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-31 05:52:41,682 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-31 05:52:42,180 WARN [Listener at localhost/38365] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-31 05:52:42,268 WARN [Listener at localhost/38365] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-31 05:52:42,295 WARN [Listener at localhost/38365] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-31 05:52:42,304 INFO [Listener at localhost/38365] log.Slf4jLog(67): jetty-6.1.26 2023-10-31 05:52:42,312 INFO [Listener at localhost/38365] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/java.io.tmpdir/Jetty_localhost_34897_datanode____.nsy5ok/webapp 2023-10-31 05:52:42,415 INFO [Listener at localhost/38365] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34897 2023-10-31 05:52:42,783 WARN [Listener at localhost/40291] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-31 05:52:43,858 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d60ab2428d0a839: Processing first storage report for DS-723bbe81-33f1-42f8-94ef-0b96d448d6e1 from datanode 0cabfc00-225c-4275-b10c-db678f1f126c 2023-10-31 05:52:43,860 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d60ab2428d0a839: from storage DS-723bbe81-33f1-42f8-94ef-0b96d448d6e1 node DatanodeRegistration(127.0.0.1:46561, datanodeUuid=0cabfc00-225c-4275-b10c-db678f1f126c, infoPort=39411, infoSecurePort=0, ipcPort=40291, storageInfo=lv=-57;cid=testClusterID;nsid=646209026;c=1698731561085), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-31 05:52:43,860 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d60ab2428d0a839: Processing first storage report for DS-f6086c44-2abc-44ad-bb13-894e1a72789e from datanode 0cabfc00-225c-4275-b10c-db678f1f126c 2023-10-31 05:52:43,860 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d60ab2428d0a839: from storage DS-f6086c44-2abc-44ad-bb13-894e1a72789e node DatanodeRegistration(127.0.0.1:46561, datanodeUuid=0cabfc00-225c-4275-b10c-db678f1f126c, infoPort=39411, infoSecurePort=0, ipcPort=40291, storageInfo=lv=-57;cid=testClusterID;nsid=646209026;c=1698731561085), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-31 05:52:43,927 DEBUG [Listener at localhost/40291] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74 2023-10-31 05:52:43,981 INFO [Listener at localhost/40291] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/cluster_8ab50123-55f1-194a-5eb5-80cabe53771a/zookeeper_0, clientPort=64652, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/cluster_8ab50123-55f1-194a-5eb5-80cabe53771a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/cluster_8ab50123-55f1-194a-5eb5-80cabe53771a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-31 05:52:43,995 INFO [Listener at localhost/40291] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64652 2023-10-31 05:52:44,007 INFO [Listener at localhost/40291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-31 05:52:44,010 INFO [Listener at localhost/40291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-31 05:52:44,675 INFO [Listener at localhost/40291] util.FSUtils(471): Created version file at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42 with version=8 2023-10-31 05:52:44,675 INFO [Listener at localhost/40291] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/hbase-staging 2023-10-31 05:52:44,933 INFO [Listener at localhost/40291] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-31 05:52:45,364 INFO [Listener at localhost/40291] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-10-31 05:52:45,391 INFO [Listener at localhost/40291] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-31 05:52:45,391 INFO [Listener at localhost/40291] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-31 05:52:45,391 INFO [Listener at localhost/40291] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-31 05:52:45,392 INFO [Listener at localhost/40291] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-31 05:52:45,392 INFO [Listener at localhost/40291] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-31 05:52:45,520 INFO [Listener at localhost/40291] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-31 05:52:45,586 DEBUG [Listener at localhost/40291] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-31 05:52:45,666 INFO [Listener at localhost/40291] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42133 2023-10-31 05:52:45,679 INFO [Listener at localhost/40291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-31 05:52:45,681 INFO [Listener at localhost/40291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-31 05:52:45,706 INFO [Listener at localhost/40291] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42133 connecting to ZooKeeper ensemble=127.0.0.1:64652 2023-10-31 05:52:45,740 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:421330x0, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-31 05:52:45,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42133-0x101868d6ce30000 connected 2023-10-31 05:52:45,766 DEBUG [Listener at localhost/40291] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-31 05:52:45,767 DEBUG [Listener at localhost/40291] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-31 05:52:45,770 DEBUG [Listener at localhost/40291] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-31 05:52:45,777 DEBUG [Listener at localhost/40291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42133 2023-10-31 05:52:45,778 DEBUG [Listener at localhost/40291] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42133 2023-10-31 05:52:45,778 DEBUG [Listener at localhost/40291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42133 2023-10-31 05:52:45,778 DEBUG [Listener at localhost/40291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42133 2023-10-31 05:52:45,779 DEBUG [Listener at localhost/40291] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42133 2023-10-31 05:52:45,784 INFO [Listener at localhost/40291] master.HMaster(444): hbase.rootdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42, hbase.cluster.distributed=false 2023-10-31 05:52:45,850 INFO [Listener at localhost/40291] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-10-31 05:52:45,850 INFO [Listener at localhost/40291] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-31 05:52:45,850 INFO [Listener at localhost/40291] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-31 05:52:45,850 INFO [Listener at localhost/40291] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-31 05:52:45,851 INFO [Listener at localhost/40291] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-31 05:52:45,851 INFO [Listener at localhost/40291] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-31 05:52:45,856 INFO [Listener at localhost/40291] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-31 05:52:45,858 INFO [Listener at localhost/40291] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43723 2023-10-31 05:52:45,860 INFO [Listener at localhost/40291] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-31 05:52:45,866 DEBUG [Listener at localhost/40291] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-10-31 05:52:45,867 INFO [Listener at localhost/40291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-31 05:52:45,871 INFO [Listener at localhost/40291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-31 05:52:45,874 INFO [Listener at localhost/40291] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43723 connecting to ZooKeeper ensemble=127.0.0.1:64652 2023-10-31 05:52:45,877 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:437230x0, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-31 05:52:45,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43723-0x101868d6ce30001 connected 2023-10-31 05:52:45,878 DEBUG [Listener at localhost/40291] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-31 05:52:45,879 DEBUG [Listener at localhost/40291] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-31 05:52:45,880 DEBUG [Listener at localhost/40291] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-31 05:52:45,881 DEBUG [Listener at localhost/40291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43723 2023-10-31 05:52:45,881 DEBUG [Listener at localhost/40291] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43723 2023-10-31 05:52:45,881 DEBUG [Listener at localhost/40291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43723 2023-10-31 05:52:45,882 DEBUG [Listener at localhost/40291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43723 2023-10-31 05:52:45,882 DEBUG [Listener at localhost/40291] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43723 2023-10-31 05:52:45,884 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,42133,1698731564798 2023-10-31 05:52:45,892 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-31 05:52:45,893 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,42133,1698731564798 2023-10-31 05:52:45,909 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-31 05:52:45,910 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-31 05:52:45,910 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-31 05:52:45,911 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-31 05:52:45,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,42133,1698731564798 from backup master directory 2023-10-31 05:52:45,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-31 05:52:45,915 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,42133,1698731564798 2023-10-31 05:52:45,915 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-31 05:52:45,916 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-31 05:52:45,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,42133,1698731564798 2023-10-31 05:52:45,920 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-31 05:52:45,921 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-31 05:52:46,403 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/hbase.id with ID: 33f1192c-c338-430e-8c91-6bbc0e01119f 2023-10-31 05:52:46,446 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-31 05:52:46,461 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-31 05:52:46,497 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x680e8dd5 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:52:46,532 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3eb90e74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:52:46,556 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-31 05:52:46,558 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-31 05:52:46,575 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-31 05:52:46,575 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-31 05:52:46,577 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-31 05:52:46,581 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-31 05:52:46,582 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-31 05:52:46,614 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/data/master/store-tmp 2023-10-31 05:52:46,646 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:52:46,646 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-31 05:52:46,647 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-31 05:52:46,647 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-31 05:52:46,647 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-31 05:52:46,647 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-31 05:52:46,647 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-31 05:52:46,647 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-31 05:52:46,649 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/WALs/jenkins-hbase20.apache.org,42133,1698731564798 2023-10-31 05:52:46,677 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42133%2C1698731564798, suffix=, logDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/WALs/jenkins-hbase20.apache.org,42133,1698731564798, archiveDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/oldWALs, maxLogs=10 2023-10-31 05:52:46,737 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46561,DS-723bbe81-33f1-42f8-94ef-0b96d448d6e1,DISK] 2023-10-31 05:52:46,745 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-31 05:52:46,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/WALs/jenkins-hbase20.apache.org,42133,1698731564798/jenkins-hbase20.apache.org%2C42133%2C1698731564798.1698731566690 2023-10-31 05:52:46,805 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46561,DS-723bbe81-33f1-42f8-94ef-0b96d448d6e1,DISK]] 2023-10-31 05:52:46,805 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:52:46,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:52:46,809 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-31 05:52:46,810 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-31 05:52:46,863 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-31 05:52:46,872 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-31 05:52:46,897 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-31 05:52:46,911 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:52:46,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-31 05:52:46,920 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-31 05:52:46,937 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-31 05:52:46,942 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:52:46,944 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63282608, jitterRate=-0.05701565742492676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:52:46,944 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-31 05:52:46,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-31 05:52:46,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-31 05:52:46,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-31 05:52:46,970 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-31 05:52:46,972 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-31 05:52:47,002 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 29 msec 2023-10-31 05:52:47,002 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-31 05:52:47,028 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-31 05:52:47,035 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-31 05:52:47,057 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-31 05:52:47,062 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-31 05:52:47,065 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-31 05:52:47,070 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-31 05:52:47,075 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-31 05:52:47,081 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-31 05:52:47,083 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-31 05:52:47,084 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-31 05:52:47,101 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-31 05:52:47,105 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-31 05:52:47,105 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-31 05:52:47,105 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-31 05:52:47,106 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,42133,1698731564798, sessionid=0x101868d6ce30000, setting cluster-up flag (Was=false) 2023-10-31 05:52:47,140 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-31 05:52:47,145 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-31 05:52:47,147 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,42133,1698731564798 2023-10-31 05:52:47,155 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-31 05:52:47,164 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-31 05:52:47,166 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,42133,1698731564798 2023-10-31 05:52:47,169 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp 2023-10-31 05:52:47,195 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(951): ClusterId : 33f1192c-c338-430e-8c91-6bbc0e01119f 2023-10-31 05:52:47,203 DEBUG [RS:0;jenkins-hbase20:43723] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-31 05:52:47,211 DEBUG [RS:0;jenkins-hbase20:43723] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-31 05:52:47,212 DEBUG [RS:0;jenkins-hbase20:43723] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-31 05:52:47,222 DEBUG [RS:0;jenkins-hbase20:43723] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-31 05:52:47,225 DEBUG [RS:0;jenkins-hbase20:43723] zookeeper.ReadOnlyZKClient(139): Connect 0x63d9fff3 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:52:47,246 DEBUG [RS:0;jenkins-hbase20:43723] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d1e0df8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:52:47,246 DEBUG [RS:0;jenkins-hbase20:43723] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69219483, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-31 05:52:47,271 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:43723 2023-10-31 05:52:47,275 INFO [RS:0;jenkins-hbase20:43723] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-31 05:52:47,275 INFO [RS:0;jenkins-hbase20:43723] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-31 05:52:47,275 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1022): About to register with Master. 2023-10-31 05:52:47,279 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,42133,1698731564798 with isa=jenkins-hbase20.apache.org/148.251.75.209:43723, startcode=1698731565849 2023-10-31 05:52:47,297 DEBUG [RS:0;jenkins-hbase20:43723] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-31 05:52:47,312 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-31 05:52:47,333 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-31 05:52:47,334 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-31 05:52:47,334 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-31 05:52:47,334 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-31 05:52:47,334 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-10-31 05:52:47,334 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,334 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-31 05:52:47,335 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,347 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1698731597347 2023-10-31 05:52:47,350 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-31 05:52:47,352 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-31 05:52:47,352 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-31 05:52:47,359 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-31 05:52:47,363 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-31 05:52:47,368 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35789, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-31 05:52:47,373 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-31 05:52:47,375 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-31 05:52:47,375 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-31 05:52:47,376 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-31 05:52:47,377 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:47,378 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42133] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-31 05:52:47,379 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-31 05:52:47,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-31 05:52:47,381 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-31 05:52:47,386 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-31 05:52:47,387 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-31 05:52:47,390 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698731567389,5,FailOnTimeoutGroup] 2023-10-31 05:52:47,391 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698731567390,5,FailOnTimeoutGroup] 2023-10-31 05:52:47,391 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:47,391 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-31 05:52:47,394 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:47,395 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:47,404 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-31 05:52:47,405 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-31 05:52:47,405 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42 2023-10-31 05:52:47,417 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(2830): Master is not running yet 2023-10-31 05:52:47,417 WARN [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-31 05:52:47,432 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:52:47,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-31 05:52:47,439 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/info 2023-10-31 05:52:47,441 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-31 05:52:47,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:52:47,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-31 05:52:47,445 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/rep_barrier 2023-10-31 05:52:47,450 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-31 05:52:47,452 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:52:47,452 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-31 05:52:47,455 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/table 2023-10-31 05:52:47,456 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-31 05:52:47,458 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:52:47,463 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740 2023-10-31 05:52:47,464 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740 2023-10-31 05:52:47,467 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-31 05:52:47,470 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-31 05:52:47,473 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:52:47,476 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70027936, jitterRate=0.043497562408447266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-31 05:52:47,476 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-31 05:52:47,476 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-31 05:52:47,476 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-31 05:52:47,477 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-31 05:52:47,477 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-31 05:52:47,477 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-31 05:52:47,477 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-31 05:52:47,478 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-31 05:52:47,484 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-31 05:52:47,485 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-31 05:52:47,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-31 05:52:47,508 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-31 05:52:47,510 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-31 05:52:47,519 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,42133,1698731564798 with isa=jenkins-hbase20.apache.org/148.251.75.209:43723, startcode=1698731565849 2023-10-31 05:52:47,525 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42133] master.ServerManager(388): Registering regionserver=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:47,531 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42 2023-10-31 05:52:47,531 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38365 2023-10-31 05:52:47,531 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-31 05:52:47,537 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-31 05:52:47,537 DEBUG [RS:0;jenkins-hbase20:43723] zookeeper.ZKUtil(162): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:47,538 WARN [RS:0;jenkins-hbase20:43723] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-31 05:52:47,543 INFO [RS:0;jenkins-hbase20:43723] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-31 05:52:47,543 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/WALs/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:47,546 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,43723,1698731565849] 2023-10-31 05:52:47,553 DEBUG [RS:0;jenkins-hbase20:43723] zookeeper.ZKUtil(162): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:47,561 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-31 05:52:47,568 INFO [RS:0;jenkins-hbase20:43723] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-31 05:52:47,583 INFO [RS:0;jenkins-hbase20:43723] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-31 05:52:47,586 INFO [RS:0;jenkins-hbase20:43723] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:52:47,587 INFO [RS:0;jenkins-hbase20:43723] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:47,588 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-31 05:52:47,594 INFO [RS:0;jenkins-hbase20:43723] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-10-31 05:52:47,594 DEBUG [RS:0;jenkins-hbase20:43723] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,595 DEBUG [RS:0;jenkins-hbase20:43723] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,595 DEBUG [RS:0;jenkins-hbase20:43723] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,595 DEBUG [RS:0;jenkins-hbase20:43723] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,595 DEBUG [RS:0;jenkins-hbase20:43723] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,595 DEBUG [RS:0;jenkins-hbase20:43723] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-31 05:52:47,595 DEBUG [RS:0;jenkins-hbase20:43723] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,595 DEBUG [RS:0;jenkins-hbase20:43723] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,596 DEBUG [RS:0;jenkins-hbase20:43723] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,596 DEBUG [RS:0;jenkins-hbase20:43723] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-31 05:52:47,597 INFO [RS:0;jenkins-hbase20:43723] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:47,597 INFO [RS:0;jenkins-hbase20:43723] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:47,597 INFO [RS:0;jenkins-hbase20:43723] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:47,609 INFO [RS:0;jenkins-hbase20:43723] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-31 05:52:47,611 INFO [RS:0;jenkins-hbase20:43723] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43723,1698731565849-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:47,628 INFO [RS:0;jenkins-hbase20:43723] regionserver.Replication(203): jenkins-hbase20.apache.org,43723,1698731565849 started 2023-10-31 05:52:47,628 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,43723,1698731565849, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:43723, sessionid=0x101868d6ce30001 2023-10-31 05:52:47,628 DEBUG [RS:0;jenkins-hbase20:43723] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-31 05:52:47,628 DEBUG [RS:0;jenkins-hbase20:43723] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:47,628 DEBUG [RS:0;jenkins-hbase20:43723] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43723,1698731565849' 2023-10-31 05:52:47,628 DEBUG [RS:0;jenkins-hbase20:43723] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:47,629 DEBUG [RS:0;jenkins-hbase20:43723] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:47,630 DEBUG [RS:0;jenkins-hbase20:43723] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-31 05:52:47,630 DEBUG [RS:0;jenkins-hbase20:43723] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-31 05:52:47,630 DEBUG [RS:0;jenkins-hbase20:43723] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:47,630 DEBUG [RS:0;jenkins-hbase20:43723] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43723,1698731565849' 2023-10-31 05:52:47,630 DEBUG [RS:0;jenkins-hbase20:43723] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-31 05:52:47,630 DEBUG [RS:0;jenkins-hbase20:43723] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-31 05:52:47,631 DEBUG [RS:0;jenkins-hbase20:43723] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-31 05:52:47,631 INFO [RS:0;jenkins-hbase20:43723] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-31 05:52:47,631 INFO [RS:0;jenkins-hbase20:43723] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-31 05:52:47,663 DEBUG [jenkins-hbase20:42133] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-10-31 05:52:47,665 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43723,1698731565849, state=OPENING 2023-10-31 05:52:47,674 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-31 05:52:47,675 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-31 05:52:47,676 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-31 05:52:47,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:52:47,743 INFO [RS:0;jenkins-hbase20:43723] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43723%2C1698731565849, suffix=, logDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/WALs/jenkins-hbase20.apache.org,43723,1698731565849, archiveDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/oldWALs, maxLogs=32 2023-10-31 05:52:47,771 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46561,DS-723bbe81-33f1-42f8-94ef-0b96d448d6e1,DISK] 2023-10-31 05:52:47,775 INFO [RS:0;jenkins-hbase20:43723] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/WALs/jenkins-hbase20.apache.org,43723,1698731565849/jenkins-hbase20.apache.org%2C43723%2C1698731565849.1698731567749 2023-10-31 05:52:47,775 DEBUG [RS:0;jenkins-hbase20:43723] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46561,DS-723bbe81-33f1-42f8-94ef-0b96d448d6e1,DISK]] 2023-10-31 05:52:47,869 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:47,871 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-31 05:52:47,874 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-31 05:52:47,886 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-31 05:52:47,886 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-31 05:52:47,890 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43723%2C1698731565849.meta, suffix=.meta, logDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/WALs/jenkins-hbase20.apache.org,43723,1698731565849, archiveDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/oldWALs, maxLogs=32 2023-10-31 05:52:47,911 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46561,DS-723bbe81-33f1-42f8-94ef-0b96d448d6e1,DISK] 2023-10-31 05:52:47,916 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/WALs/jenkins-hbase20.apache.org,43723,1698731565849/jenkins-hbase20.apache.org%2C43723%2C1698731565849.meta.1698731567893.meta 2023-10-31 05:52:47,917 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46561,DS-723bbe81-33f1-42f8-94ef-0b96d448d6e1,DISK]] 2023-10-31 05:52:47,917 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:52:47,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-31 05:52:47,937 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-31 05:52:47,942 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-31 05:52:47,947 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-31 05:52:47,947 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:52:47,947 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-31 05:52:47,947 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-31 05:52:47,950 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-31 05:52:47,952 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/info 2023-10-31 05:52:47,952 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/info 2023-10-31 05:52:47,953 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-31 05:52:47,954 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:52:47,954 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-31 05:52:47,956 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/rep_barrier 2023-10-31 05:52:47,956 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/rep_barrier 2023-10-31 05:52:47,957 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-31 05:52:47,958 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:52:47,958 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-31 05:52:47,960 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/table 2023-10-31 05:52:47,960 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/table 2023-10-31 05:52:47,960 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-31 05:52:47,961 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:52:47,963 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740 2023-10-31 05:52:47,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740 2023-10-31 05:52:47,970 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-31 05:52:47,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-31 05:52:47,975 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72959770, jitterRate=0.08718529343605042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-31 05:52:47,975 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-31 05:52:47,985 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1698731567864 2023-10-31 05:52:48,004 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-31 05:52:48,005 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-31 05:52:48,005 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43723,1698731565849, state=OPEN 2023-10-31 05:52:48,008 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-31 05:52:48,008 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-31 05:52:48,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-31 05:52:48,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43723,1698731565849 in 328 msec 2023-10-31 05:52:48,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-31 05:52:48,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 517 msec 2023-10-31 05:52:48,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 783 msec 2023-10-31 05:52:48,025 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1698731568025, completionTime=-1 2023-10-31 05:52:48,025 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-10-31 05:52:48,025 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-10-31 05:52:48,085 DEBUG [hconnection-0x49fe88d6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:52:48,096 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:52:48,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-10-31 05:52:48,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1698731628115 2023-10-31 05:52:48,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1698731688115 2023-10-31 05:52:48,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 89 msec 2023-10-31 05:52:48,137 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42133,1698731564798-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:48,137 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42133,1698731564798-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:48,137 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42133,1698731564798-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:48,139 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:42133, period=300000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:48,139 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-31 05:52:48,145 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-31 05:52:48,152 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-31 05:52:48,153 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-31 05:52:48,161 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-31 05:52:48,166 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:52:48,168 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:52:48,190 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5 2023-10-31 05:52:48,192 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5 empty. 2023-10-31 05:52:48,193 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5 2023-10-31 05:52:48,193 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-31 05:52:48,224 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-31 05:52:48,226 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c6b985ab7f7859b84143c402f7db58c5, NAME => 'hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:52:48,240 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:52:48,240 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c6b985ab7f7859b84143c402f7db58c5, disabling compactions & flushes 2023-10-31 05:52:48,240 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:52:48,240 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:52:48,240 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. after waiting 0 ms 2023-10-31 05:52:48,240 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:52:48,241 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:52:48,241 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c6b985ab7f7859b84143c402f7db58c5: 2023-10-31 05:52:48,245 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:52:48,258 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698731568248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731568248"}]},"ts":"1698731568248"} 2023-10-31 05:52:48,282 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-31 05:52:48,284 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:52:48,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731568284"}]},"ts":"1698731568284"} 2023-10-31 05:52:48,293 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-31 05:52:48,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c6b985ab7f7859b84143c402f7db58c5, ASSIGN}] 2023-10-31 05:52:48,303 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c6b985ab7f7859b84143c402f7db58c5, ASSIGN 2023-10-31 05:52:48,305 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c6b985ab7f7859b84143c402f7db58c5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:52:48,456 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c6b985ab7f7859b84143c402f7db58c5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:48,457 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698731568456"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731568456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731568456"}]},"ts":"1698731568456"} 2023-10-31 05:52:48,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c6b985ab7f7859b84143c402f7db58c5, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:52:48,619 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:48,628 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:52:48,630 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c6b985ab7f7859b84143c402f7db58c5, NAME => 'hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:52:48,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c6b985ab7f7859b84143c402f7db58c5 2023-10-31 05:52:48,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:52:48,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c6b985ab7f7859b84143c402f7db58c5 2023-10-31 05:52:48,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c6b985ab7f7859b84143c402f7db58c5 2023-10-31 05:52:48,633 INFO [StoreOpener-c6b985ab7f7859b84143c402f7db58c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c6b985ab7f7859b84143c402f7db58c5 2023-10-31 05:52:48,636 DEBUG [StoreOpener-c6b985ab7f7859b84143c402f7db58c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5/info 2023-10-31 05:52:48,636 DEBUG [StoreOpener-c6b985ab7f7859b84143c402f7db58c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5/info 2023-10-31 05:52:48,637 INFO [StoreOpener-c6b985ab7f7859b84143c402f7db58c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6b985ab7f7859b84143c402f7db58c5 columnFamilyName info 2023-10-31 05:52:48,638 INFO [StoreOpener-c6b985ab7f7859b84143c402f7db58c5-1] regionserver.HStore(310): Store=c6b985ab7f7859b84143c402f7db58c5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:52:48,639 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5 2023-10-31 05:52:48,640 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5 2023-10-31 05:52:48,645 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c6b985ab7f7859b84143c402f7db58c5 2023-10-31 05:52:48,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:52:48,650 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c6b985ab7f7859b84143c402f7db58c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72778772, jitterRate=0.08448821306228638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:52:48,650 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c6b985ab7f7859b84143c402f7db58c5: 2023-10-31 05:52:48,653 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5., pid=6, masterSystemTime=1698731568619 2023-10-31 05:52:48,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:52:48,658 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:52:48,659 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c6b985ab7f7859b84143c402f7db58c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:48,660 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698731568659"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731568659"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731568659"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731568659"}]},"ts":"1698731568659"} 2023-10-31 05:52:48,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-31 05:52:48,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c6b985ab7f7859b84143c402f7db58c5, server=jenkins-hbase20.apache.org,43723,1698731565849 in 200 msec 2023-10-31 05:52:48,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-31 05:52:48,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c6b985ab7f7859b84143c402f7db58c5, ASSIGN in 368 msec 2023-10-31 05:52:48,673 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:52:48,674 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731568674"}]},"ts":"1698731568674"} 2023-10-31 05:52:48,677 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-31 05:52:48,679 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:52:48,682 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 527 msec 2023-10-31 05:52:48,765 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-31 05:52:48,766 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-31 05:52:48,766 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-31 05:52:48,807 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-31 05:52:48,829 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-31 05:52:48,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-10-31 05:52:48,843 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-31 05:52:48,856 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-31 05:52:48,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-10-31 05:52:48,868 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-31 05:52:48,870 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-31 05:52:48,870 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.954sec 2023-10-31 05:52:48,872 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-31 05:52:48,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-31 05:52:48,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-31 05:52:48,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42133,1698731564798-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-31 05:52:48,875 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42133,1698731564798-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-31 05:52:48,886 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-31 05:52:48,899 DEBUG [Listener at localhost/40291] zookeeper.ReadOnlyZKClient(139): Connect 0x07641ea7 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:52:48,904 DEBUG [Listener at localhost/40291] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f34b195, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:52:48,923 DEBUG [hconnection-0x59dda6d8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:52:48,949 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:52:48,959 INFO [Listener at localhost/40291] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,42133,1698731564798 2023-10-31 05:52:48,962 DEBUG [Listener at localhost/40291] zookeeper.ReadOnlyZKClient(139): Connect 0x4829393b to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:52:48,966 DEBUG [Listener at localhost/40291] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49d73520, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:52:48,967 INFO [Listener at localhost/40291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-31 05:52:48,989 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=212, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=169, AvailableMemoryMB=2251 2023-10-31 05:52:49,000 DEBUG [Listener at localhost/40291] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:52:49,004 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:52:49,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-31 05:52:49,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:49,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:52:49,024 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:52:49,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-10-31 05:52:49,028 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:49,029 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be empty. 2023-10-31 05:52:49,031 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:49,031 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-10-31 05:52:49,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-31 05:52:49,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-31 05:52:49,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-31 05:52:49,452 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-31 05:52:49,456 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => e848040dfe4476a52f6685d5355a71be, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:52:49,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-31 05:52:49,870 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:52:49,871 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing e848040dfe4476a52f6685d5355a71be, disabling compactions & flushes 2023-10-31 05:52:49,871 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:49,871 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:49,871 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. after waiting 0 ms 2023-10-31 05:52:49,871 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:49,871 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:49,871 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:49,877 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:52:49,878 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698731569878"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731569878"}]},"ts":"1698731569878"} 2023-10-31 05:52:49,881 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-31 05:52:49,883 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:52:49,883 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731569883"}]},"ts":"1698731569883"} 2023-10-31 05:52:49,886 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-10-31 05:52:49,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e848040dfe4476a52f6685d5355a71be, ASSIGN}] 2023-10-31 05:52:49,891 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e848040dfe4476a52f6685d5355a71be, ASSIGN 2023-10-31 05:52:49,893 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e848040dfe4476a52f6685d5355a71be, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:52:50,044 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e848040dfe4476a52f6685d5355a71be, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:50,045 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698731570044"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731570044"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731570044"}]},"ts":"1698731570044"} 2023-10-31 05:52:50,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e848040dfe4476a52f6685d5355a71be, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:52:50,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-31 05:52:50,202 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:50,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:50,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e848040dfe4476a52f6685d5355a71be, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:52:50,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:50,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:52:50,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:50,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:50,213 INFO [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:50,216 DEBUG [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1 2023-10-31 05:52:50,216 DEBUG [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1 2023-10-31 05:52:50,220 INFO [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e848040dfe4476a52f6685d5355a71be columnFamilyName family1 2023-10-31 05:52:50,224 INFO [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] regionserver.HStore(310): Store=e848040dfe4476a52f6685d5355a71be/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:52:50,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:50,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:50,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:50,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:52:50,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e848040dfe4476a52f6685d5355a71be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65346025, jitterRate=-0.02626834809780121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:52:50,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:50,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be., pid=11, masterSystemTime=1698731570202 2023-10-31 05:52:50,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:50,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:50,241 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e848040dfe4476a52f6685d5355a71be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:50,241 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698731570241"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731570241"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731570241"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731570241"}]},"ts":"1698731570241"} 2023-10-31 05:52:50,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-31 05:52:50,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e848040dfe4476a52f6685d5355a71be, server=jenkins-hbase20.apache.org,43723,1698731565849 in 196 msec 2023-10-31 05:52:50,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-31 05:52:50,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e848040dfe4476a52f6685d5355a71be, ASSIGN in 358 msec 2023-10-31 05:52:50,252 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:52:50,253 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731570252"}]},"ts":"1698731570252"} 2023-10-31 05:52:50,255 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-10-31 05:52:50,257 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:52:50,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2400 sec 2023-10-31 05:52:51,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-31 05:52:51,160 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-10-31 05:52:51,181 DEBUG [hconnection-0x67d2b7a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:52:51,183 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:52:51,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:52:51,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:51,319 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:51,319 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:51,319 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-31 05:52:51,319 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-31 05:52:51,320 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:51,320 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:51,321 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:51,321 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:51,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:51,321 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:51,321 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:52:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:51,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:52:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:51,323 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:51,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:51,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-31 05:52:51,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:51,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-31 05:52:51,326 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:52:51,326 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:52:51,326 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:51,326 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. started... 2023-10-31 05:52:51,327 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e848040dfe4476a52f6685d5355a71be 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-31 05:52:51,869 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113045753e34eb3e417aba54059960f72ac7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113045753e34eb3e417aba54059960f72ac7 2023-10-31 05:52:52,285 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/2450fd8a81c541058b44987f966acdbb 2023-10-31 05:52:52,301 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/2450fd8a81c541058b44987f966acdbb as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2450fd8a81c541058b44987f966acdbb 2023-10-31 05:52:52,309 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2450fd8a81c541058b44987f966acdbb, entries=1000, sequenceid=5, filesize=175.8 K 2023-10-31 05:52:52,312 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e848040dfe4476a52f6685d5355a71be in 985ms, sequenceid=5, compaction requested=false 2023-10-31 05:52:52,314 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:52,317 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:52,317 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:52,317 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:52:52,317 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:52:52,317 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,318 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-31 05:52:52,318 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-31 05:52:52,320 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,321 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:52,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:52,321 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,321 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:52:52,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:52,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:52,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:52,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-31 05:52:52,323 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-31 05:52:52,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bc832[Count = 0] remaining members to acquire global barrier 2023-10-31 05:52:52,324 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,325 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-31 05:52:52,325 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-31 05:52:52,325 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:52:52,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:52:52,327 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-31 05:52:52,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:52,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:52,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:52,328 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-31 05:52:52,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:52,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:52:52,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-31 05:52:52,333 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-31 05:52:52,333 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:52:52,333 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:52:52,333 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,333 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:52:52,343 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,343 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,343 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:52,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:52,344 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:52,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,346 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:52,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,355 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,355 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:52,355 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:52,355 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:52,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:52,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:52:52,355 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,355 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:52,355 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,356 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,356 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,356 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:52,357 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-31 05:52:52,357 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:52:52,457 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:52:52,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:52:52,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:52:52,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-31 05:52:52,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,475 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:52,475 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:52,476 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-31 05:52:52,476 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-31 05:52:52,476 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,476 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,477 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:52,478 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:52,478 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:52,478 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:52:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:52:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,479 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,479 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-31 05:52:52,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:52,479 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-31 05:52:52,479 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:52,480 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-31 05:52:52,480 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:52:52,480 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:52,480 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:52:52,480 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. started... 2023-10-31 05:52:52,480 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e848040dfe4476a52f6685d5355a71be 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-31 05:52:52,910 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e594a595c932452d8268735db359eab0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e594a595c932452d8268735db359eab0 2023-10-31 05:52:53,326 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/3661dea099da414bab947a7b863ce14a 2023-10-31 05:52:53,340 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/3661dea099da414bab947a7b863ce14a as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3661dea099da414bab947a7b863ce14a 2023-10-31 05:52:53,351 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3661dea099da414bab947a7b863ce14a, entries=1, sequenceid=9, filesize=5.0 K 2023-10-31 05:52:53,353 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e848040dfe4476a52f6685d5355a71be in 873ms, sequenceid=9, compaction requested=false 2023-10-31 05:52:53,354 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:53,354 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:53,354 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:52:53,354 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:52:53,355 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,355 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-31 05:52:53,355 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-31 05:52:53,357 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,357 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:53,357 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,357 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:52:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:53,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-31 05:52:53,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5edcef7b[Count = 0] remaining members to acquire global barrier 2023-10-31 05:52:53,359 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-31 05:52:53,359 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,360 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,360 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-31 05:52:53,361 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-31 05:52:53,361 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:52:53,361 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,361 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:52:53,364 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-31 05:52:53,364 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,364 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:53,364 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-31 05:52:53,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:53,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:52:53,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-31 05:52:53,369 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-31 05:52:53,369 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:52:53,369 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:52:53,369 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,369 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:52:53,376 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,376 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:53,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:53,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,376 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:53,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:53,377 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,379 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,385 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,385 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,385 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,385 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,385 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:53,385 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,385 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:53,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:53,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:52:53,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:53,385 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:53,385 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:53,386 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,386 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-31 05:52:53,386 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:52:53,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:53,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:53,473 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:52:53,486 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:52:53,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:52:53,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:52:53,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-31 05:52:53,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,501 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:53,501 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:53,501 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-31 05:52:53,501 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-31 05:52:53,502 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,502 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,503 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:53,503 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:52:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,505 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,505 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-31 05:52:53,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,505 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-31 05:52:53,505 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:53,506 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-31 05:52:53,506 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:52:53,506 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:52:53,506 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:53,506 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. started... 2023-10-31 05:52:53,506 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e848040dfe4476a52f6685d5355a71be 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:52:53,507 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,507 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:52:53,538 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014bf064a4dff246339c8135f02027ab3d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014bf064a4dff246339c8135f02027ab3d 2023-10-31 05:52:53,565 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-31 05:52:53,567 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-31 05:52:53,953 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/5dd8afedd8e144c79c3e04111fedf330 2023-10-31 05:52:53,964 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/5dd8afedd8e144c79c3e04111fedf330 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/5dd8afedd8e144c79c3e04111fedf330 2023-10-31 05:52:53,975 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/5dd8afedd8e144c79c3e04111fedf330, entries=1, sequenceid=13, filesize=5.0 K 2023-10-31 05:52:53,976 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e848040dfe4476a52f6685d5355a71be in 470ms, sequenceid=13, compaction requested=true 2023-10-31 05:52:53,976 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:53,976 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:53,976 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:52:53,977 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:52:53,977 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,977 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-31 05:52:53,977 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-31 05:52:53,979 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,979 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:53,979 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,979 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:52:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:53,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-31 05:52:53,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51e43a36[Count = 0] remaining members to acquire global barrier 2023-10-31 05:52:53,981 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-31 05:52:53,981 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,982 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,982 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-31 05:52:53,982 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-31 05:52:53,982 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:52:53,982 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,982 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:52:53,984 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-31 05:52:53,984 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,984 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:53,984 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-31 05:52:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:53,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:53,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:52:53,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-31 05:52:53,987 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-31 05:52:53,987 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:52:53,987 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:52:53,987 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,988 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:52:53,989 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,989 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:53,989 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,990 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:53,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,991 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:53,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,995 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:53,995 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:53,995 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:53,995 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:53,995 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:53,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:52:53,996 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,996 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:53,996 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,996 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,996 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:53,996 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-31 05:52:53,996 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:52:53,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:53,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-31 05:52:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:54,097 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:52:54,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:52:54,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:52:54,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-31 05:52:54,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,112 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:54,112 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:54,113 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-31 05:52:54,113 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-31 05:52:54,113 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,113 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,114 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:54,114 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:54,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:54,115 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,115 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:52:54,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:52:54,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,116 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,116 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-31 05:52:54,116 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,116 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-31 05:52:54,116 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:54,117 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-31 05:52:54,118 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:52:54,118 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:52:54,118 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:54,118 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. started... 2023-10-31 05:52:54,118 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e848040dfe4476a52f6685d5355a71be 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:52:54,149 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056744b93a385e459491b7340f7765ac06 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056744b93a385e459491b7340f7765ac06 2023-10-31 05:52:54,563 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/3d7ed569e3a644d3b6a6979259d7c656 2023-10-31 05:52:54,574 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/3d7ed569e3a644d3b6a6979259d7c656 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3d7ed569e3a644d3b6a6979259d7c656 2023-10-31 05:52:54,584 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3d7ed569e3a644d3b6a6979259d7c656, entries=1, sequenceid=17, filesize=5.0 K 2023-10-31 05:52:54,585 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e848040dfe4476a52f6685d5355a71be in 467ms, sequenceid=17, compaction requested=true 2023-10-31 05:52:54,585 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:54,586 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:54,586 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:52:54,587 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:52:54,587 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,587 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-31 05:52:54,587 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-31 05:52:54,588 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,588 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:54,589 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,589 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:52:54,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:54,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:54,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:54,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-31 05:52:54,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5415314d[Count = 0] remaining members to acquire global barrier 2023-10-31 05:52:54,592 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-31 05:52:54,592 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,593 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,593 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-31 05:52:54,593 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-31 05:52:54,593 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:52:54,593 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,593 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:52:54,595 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-31 05:52:54,595 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,595 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:54,595 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-31 05:52:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:52:54,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-31 05:52:54,599 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-31 05:52:54,599 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:52:54,599 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:52:54,599 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,599 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:52:54,600 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,600 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,600 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:54,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:54,601 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,603 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,615 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:54,615 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,615 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:54,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:54,615 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:54,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-31 05:52:54,615 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:54,616 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:52:54,616 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:54,616 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,616 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,616 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,616 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-31 05:52:54,616 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:52:54,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:54,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:54,717 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:52:54,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:52:54,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:52:54,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-31 05:52:54,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,730 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:54,730 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:54,730 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-31 05:52:54,730 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-31 05:52:54,731 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,731 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,732 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,732 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:54,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:54,732 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:54,732 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:52:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:52:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,733 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-31 05:52:54,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:54,734 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-31 05:52:54,734 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:54,734 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-31 05:52:54,735 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:52:54,735 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:54,735 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:52:54,735 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. started... 2023-10-31 05:52:54,735 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e848040dfe4476a52f6685d5355a71be 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:52:54,925 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-31 05:52:54,926 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-31 05:52:55,165 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122899188f090a144af59fb20f8f567723d7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122899188f090a144af59fb20f8f567723d7 2023-10-31 05:52:55,181 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/0ff7d04e3b244b2fa579a07936ea8562 2023-10-31 05:52:55,193 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/0ff7d04e3b244b2fa579a07936ea8562 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/0ff7d04e3b244b2fa579a07936ea8562 2023-10-31 05:52:55,208 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/0ff7d04e3b244b2fa579a07936ea8562, entries=1, sequenceid=21, filesize=5.0 K 2023-10-31 05:52:55,209 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e848040dfe4476a52f6685d5355a71be in 474ms, sequenceid=21, compaction requested=true 2023-10-31 05:52:55,209 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:55,210 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:55,210 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:52:55,210 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:52:55,210 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,210 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-31 05:52:55,210 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-31 05:52:55,214 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,214 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:55,215 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,215 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:52:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:55,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-31 05:52:55,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a7149a5[Count = 0] remaining members to acquire global barrier 2023-10-31 05:52:55,217 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-31 05:52:55,217 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,226 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,226 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-31 05:52:55,226 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,226 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:52:55,226 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-31 05:52:55,227 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:52:55,228 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-31 05:52:55,228 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,228 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:55,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,228 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-31 05:52:55,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:52:55,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-31 05:52:55,232 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-31 05:52:55,232 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:52:55,232 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:52:55,232 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,232 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:52:55,234 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,234 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:55,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,234 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:55,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,235 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,237 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,239 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:55,239 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:55,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:55,239 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:55,239 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,239 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:55,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:55,240 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:52:55,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:55,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:55,246 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,247 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,247 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,247 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,247 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-31 05:52:55,247 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:52:55,347 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:52:55,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:52:55,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:52:55,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-31 05:52:55,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,366 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:55,366 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:55,366 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-31 05:52:55,366 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-31 05:52:55,367 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,367 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,368 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,368 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:55,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:55,368 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,368 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:52:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:52:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,369 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,370 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-31 05:52:55,370 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,370 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-31 05:52:55,370 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:55,370 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-31 05:52:55,370 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:52:55,371 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:52:55,371 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:55,371 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. started... 2023-10-31 05:52:55,371 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e848040dfe4476a52f6685d5355a71be 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:52:55,400 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a2b616117a154a72bb2248fda6936a5a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a2b616117a154a72bb2248fda6936a5a 2023-10-31 05:52:55,421 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/1d9d78c19e2146d9a45a59a4cd62869d 2023-10-31 05:52:55,434 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/1d9d78c19e2146d9a45a59a4cd62869d as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/1d9d78c19e2146d9a45a59a4cd62869d 2023-10-31 05:52:55,445 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/1d9d78c19e2146d9a45a59a4cd62869d, entries=1, sequenceid=25, filesize=5.0 K 2023-10-31 05:52:55,447 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e848040dfe4476a52f6685d5355a71be in 76ms, sequenceid=25, compaction requested=true 2023-10-31 05:52:55,447 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:55,447 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:55,447 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:52:55,448 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:52:55,448 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,448 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-31 05:52:55,448 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-31 05:52:55,449 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,449 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:55,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:55,450 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,450 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:52:55,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:55,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:55,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:55,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-31 05:52:55,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33efc8a7[Count = 0] remaining members to acquire global barrier 2023-10-31 05:52:55,452 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-31 05:52:55,452 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,452 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,453 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-31 05:52:55,453 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-31 05:52:55,453 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:52:55,453 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,453 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:52:55,454 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,454 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-31 05:52:55,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:55,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:55,454 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:55,454 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-31 05:52:55,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:55,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:55,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:55,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:52:55,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-31 05:52:55,458 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-31 05:52:55,458 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:52:55,458 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:52:55,458 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,458 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:52:55,460 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,460 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:55,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:55,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:55,461 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:55,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:55,461 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:55,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:55,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,463 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:55,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,464 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,464 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,465 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,465 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:55,465 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:55,465 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:55,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:55,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:52:55,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-31 05:52:55,465 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:55,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:55,465 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,466 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,466 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,466 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-31 05:52:55,466 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:52:55,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:55,566 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:52:55,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:52:55,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:52:55,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-31 05:52:55,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,578 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:55,578 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:55,578 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-31 05:52:55,578 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-31 05:52:55,579 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,579 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,579 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,579 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:55,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:55,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:55,580 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,580 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:52:55,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:52:55,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,581 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,582 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-31 05:52:55,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,582 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-31 05:52:55,582 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:55,582 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-31 05:52:55,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:52:55,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:52:55,583 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:55,583 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. started... 2023-10-31 05:52:55,583 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e848040dfe4476a52f6685d5355a71be 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:52:55,619 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101bb286e8c03c04907af86fc5821d7af49 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101bb286e8c03c04907af86fc5821d7af49 2023-10-31 05:52:55,676 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/e9514270dfa64796bacfa1ac41575001 2023-10-31 05:52:55,688 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/e9514270dfa64796bacfa1ac41575001 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e9514270dfa64796bacfa1ac41575001 2023-10-31 05:52:55,698 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e9514270dfa64796bacfa1ac41575001, entries=1, sequenceid=29, filesize=5.0 K 2023-10-31 05:52:55,699 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e848040dfe4476a52f6685d5355a71be in 116ms, sequenceid=29, compaction requested=true 2023-10-31 05:52:55,699 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:55,700 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:55,700 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:52:55,700 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:52:55,700 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,700 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-31 05:52:55,701 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-31 05:52:55,702 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,702 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:55,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:55,703 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,703 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:52:55,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:55,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-31 05:52:55,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43aa6166[Count = 0] remaining members to acquire global barrier 2023-10-31 05:52:55,705 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-31 05:52:55,706 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,707 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,707 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-31 05:52:55,707 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-31 05:52:55,707 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,707 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:52:55,707 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:52:55,708 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-31 05:52:55,708 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,708 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:55,708 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-31 05:52:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:55,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:55,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:55,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:52:55,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-31 05:52:55,712 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-31 05:52:55,712 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:52:55,712 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:52:55,712 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,712 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:52:55,713 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,713 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,713 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:55,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:55,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:55,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:55,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:55,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:55,714 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,716 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:55,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,719 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:55,719 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,719 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:55,719 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:55,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:52:55,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:55,719 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:55,719 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,720 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,720 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,720 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,720 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,720 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-31 05:52:55,721 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:52:55,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:55,821 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:52:55,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:52:55,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:52:55,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-31 05:52:55,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,837 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:55,837 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:55,838 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-31 05:52:55,838 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-31 05:52:55,838 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,839 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,839 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:55,839 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:55,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:55,840 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:55,840 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:52:55,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:52:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,841 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,841 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-31 05:52:55,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:55,842 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-31 05:52:55,842 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:55,842 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-31 05:52:55,843 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:52:55,843 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:52:55,843 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:55,843 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. started... 2023-10-31 05:52:55,843 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e848040dfe4476a52f6685d5355a71be 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:52:55,873 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cf4c9a9faeac4f3fa4e841d4efb6a7e2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103cf4c9a9faeac4f3fa4e841d4efb6a7e2 2023-10-31 05:52:56,290 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/698df8ae86494ddca658b45991c3d98e 2023-10-31 05:52:56,300 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/698df8ae86494ddca658b45991c3d98e as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/698df8ae86494ddca658b45991c3d98e 2023-10-31 05:52:56,312 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/698df8ae86494ddca658b45991c3d98e, entries=1, sequenceid=33, filesize=5.0 K 2023-10-31 05:52:56,313 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e848040dfe4476a52f6685d5355a71be in 470ms, sequenceid=33, compaction requested=true 2023-10-31 05:52:56,314 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:56,314 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:56,314 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:52:56,314 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:52:56,315 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,315 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-31 05:52:56,315 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-31 05:52:56,317 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,317 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:56,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:56,317 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,317 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:52:56,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:56,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:56,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:56,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-31 05:52:56,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e48bf07[Count = 0] remaining members to acquire global barrier 2023-10-31 05:52:56,319 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-31 05:52:56,319 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,320 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,321 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,321 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-31 05:52:56,321 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-31 05:52:56,321 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:52:56,321 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:52:56,322 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-31 05:52:56,322 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:56,322 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:56,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:56,322 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-31 05:52:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:56,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:56,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:56,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:52:56,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-31 05:52:56,336 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-31 05:52:56,336 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:52:56,336 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:52:56,336 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,336 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:52:56,337 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,337 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:56,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,338 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:56,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:56,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:56,339 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,342 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,351 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,351 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:56,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:56,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:52:56,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:56,351 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:56,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-31 05:52:56,351 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:56,351 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,352 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:56,352 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,352 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-31 05:52:56,353 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,353 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:52:56,353 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,353 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:56,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:56,453 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:52:56,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:52:56,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:52:56,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-31 05:52:56,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,470 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:56,471 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:56,471 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-31 05:52:56,471 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-31 05:52:56,472 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,472 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,473 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,473 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:56,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:56,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:56,473 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,473 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:52:56,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:52:56,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,474 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,474 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-31 05:52:56,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,475 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-31 05:52:56,475 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:56,475 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-31 05:52:56,475 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:52:56,475 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:52:56,476 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:56,476 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. started... 2023-10-31 05:52:56,476 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e848040dfe4476a52f6685d5355a71be 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:52:56,510 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079baea3b66cc44e34b0ddc3724162a14f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509079baea3b66cc44e34b0ddc3724162a14f 2023-10-31 05:52:56,930 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/2e3f8176a86a4ddebc91195b55570bbe 2023-10-31 05:52:56,942 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/2e3f8176a86a4ddebc91195b55570bbe as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2e3f8176a86a4ddebc91195b55570bbe 2023-10-31 05:52:56,952 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2e3f8176a86a4ddebc91195b55570bbe, entries=1, sequenceid=37, filesize=5.0 K 2023-10-31 05:52:56,959 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e848040dfe4476a52f6685d5355a71be in 482ms, sequenceid=37, compaction requested=true 2023-10-31 05:52:56,959 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:56,959 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:56,959 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:52:56,960 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:52:56,960 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,960 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-31 05:52:56,960 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-31 05:52:56,962 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,962 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:56,962 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,962 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:52:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:56,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-31 05:52:56,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e74f50a[Count = 0] remaining members to acquire global barrier 2023-10-31 05:52:56,965 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-31 05:52:56,965 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,966 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,966 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,967 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:52:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,967 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-31 05:52:56,967 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-31 05:52:56,967 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:52:56,973 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-31 05:52:56,973 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,973 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:56,973 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-31 05:52:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:56,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:56,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:56,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:52:56,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-31 05:52:56,976 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-31 05:52:56,977 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:52:56,977 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:52:56,977 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,977 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:52:56,978 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,978 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:56,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,978 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:56,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:56,979 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:56,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,982 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,993 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:56,993 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:56,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:56,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:56,994 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,994 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,994 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,994 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:56,994 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,994 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,994 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:56,994 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:56,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:56,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:52:56,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-31 05:52:56,996 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-31 05:52:56,996 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:52:57,096 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:52:57,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:52:57,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:52:57,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-31 05:52:57,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:57,109 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:57,109 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:57,110 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-31 05:52:57,110 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-31 05:52:57,111 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:57,111 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:57,112 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:57,112 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:57,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:57,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:57,112 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:57,112 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:52:57,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:57,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:57,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:52:57,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:57,113 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:57,114 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-31 05:52:57,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:57,114 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-31 05:52:57,114 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:52:57,115 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-31 05:52:57,116 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:52:57,116 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:52:57,116 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:57,116 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. started... 2023-10-31 05:52:57,117 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e848040dfe4476a52f6685d5355a71be 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:52:57,563 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112068dbccd8dcb14cf8be1da06fa430169a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112068dbccd8dcb14cf8be1da06fa430169a 2023-10-31 05:52:57,990 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/8a4c69cae4b647b99bff94728b9034fb 2023-10-31 05:52:58,005 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/8a4c69cae4b647b99bff94728b9034fb as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/8a4c69cae4b647b99bff94728b9034fb 2023-10-31 05:52:58,014 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/8a4c69cae4b647b99bff94728b9034fb, entries=1, sequenceid=41, filesize=5.0 K 2023-10-31 05:52:58,015 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e848040dfe4476a52f6685d5355a71be in 898ms, sequenceid=41, compaction requested=true 2023-10-31 05:52:58,015 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:58,016 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:58,016 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:52:58,016 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:52:58,016 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,017 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-31 05:52:58,017 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-31 05:52:58,019 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:58,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:58,019 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:58,020 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,020 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:52:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:58,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:58,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-31 05:52:58,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7313b893[Count = 0] remaining members to acquire global barrier 2023-10-31 05:52:58,034 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-31 05:52:58,035 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,038 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,038 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-31 05:52:58,038 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-31 05:52:58,038 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,038 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:52:58,038 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:52:58,040 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-31 05:52:58,040 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:58,040 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-31 05:52:58,042 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:58,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:52:58,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-31 05:52:58,045 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-31 05:52:58,046 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:52:58,046 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:52:58,046 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,053 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:52:58,055 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,055 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:58,055 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:52:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:52:58,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:52:58,056 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:52:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,058 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:52:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,068 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:52:58,068 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,068 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:52:58,068 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:52:58,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:52:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:52:58,068 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-31 05:52:58,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:52:58,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:52:58,069 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,069 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:58,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:52:58,069 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,069 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-31 05:52:58,069 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,069 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-31 05:52:58,069 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:52:58,170 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:52:58,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:52:58,180 DEBUG [Listener at localhost/40291] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-31 05:52:58,184 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-31 05:52:58,185 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:58,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-31 05:52:58,225 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-31 05:52:58,227 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732178227 2023-10-31 05:52:58,227 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:52:58,229 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:52:58,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-31 05:52:58,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-31 05:52:58,237 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x5f8a9a4d to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:52:58,251 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8995806, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:52:58,266 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:52:58,872 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103897dd1304158461884ce5743827ac056 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103897dd1304158461884ce5743827ac056 2023-10-31 05:52:58,874 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-31 05:52:58,895 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:52:58,897 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:52:58,910 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:52:58,912 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:52:58,958 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7dbf908474fd4495a0cf9fe2745a3bb7 first=Optional[r3] last=Optional[r6] 2023-10-31 05:52:58,971 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7dbf908474fd4495a0cf9fe2745a3bb7}] 2023-10-31 05:52:58,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7dbf908474fd4495a0cf9fe2745a3bb7 for inclusion in e848040dfe4476a52f6685d5355a71be/family1 2023-10-31 05:52:58,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-31 05:52:58,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:52:58,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:58,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7dbf908474fd4495a0cf9fe2745a3bb7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fua9rgmimnthfae03vn5onmtftkgea2dbngj68lcqvrnq88e4ioa7k09hl5jijvn/family1/7dbf908474fd4495a0cf9fe2745a3bb7 2023-10-31 05:52:59,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fua9rgmimnthfae03vn5onmtftkgea2dbngj68lcqvrnq88e4ioa7k09hl5jijvn/family1/7dbf908474fd4495a0cf9fe2745a3bb7 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/a9dadd3a5468435b8489109154e04b2f_SeqId_44_ 2023-10-31 05:52:59,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fua9rgmimnthfae03vn5onmtftkgea2dbngj68lcqvrnq88e4ioa7k09hl5jijvn/family1/7dbf908474fd4495a0cf9fe2745a3bb7 into e848040dfe4476a52f6685d5355a71be/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/a9dadd3a5468435b8489109154e04b2f_SeqId_44_ - updating store file list. 2023-10-31 05:52:59,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/a9dadd3a5468435b8489109154e04b2f_SeqId_44_ into e848040dfe4476a52f6685d5355a71be/family1 2023-10-31 05:52:59,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fua9rgmimnthfae03vn5onmtftkgea2dbngj68lcqvrnq88e4ioa7k09hl5jijvn/family1/7dbf908474fd4495a0cf9fe2745a3bb7 into e848040dfe4476a52f6685d5355a71be/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/a9dadd3a5468435b8489109154e04b2f_SeqId_44_) 2023-10-31 05:52:59,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fua9rgmimnthfae03vn5onmtftkgea2dbngj68lcqvrnq88e4ioa7k09hl5jijvn/family1/7dbf908474fd4495a0cf9fe2745a3bb7 2023-10-31 05:52:59,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-31 05:52:59,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-31 05:52:59,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): e848040dfe4476a52f6685d5355a71be/family1 is initiating minor compaction 2023-10-31 05:52:59,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@671d553a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:52:59,023 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e848040dfe4476a52f6685d5355a71be/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:59,024 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3661dea099da414bab947a7b863ce14a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/5dd8afedd8e144c79c3e04111fedf330, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3d7ed569e3a644d3b6a6979259d7c656, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/0ff7d04e3b244b2fa579a07936ea8562, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/1d9d78c19e2146d9a45a59a4cd62869d, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e9514270dfa64796bacfa1ac41575001, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/698df8ae86494ddca658b45991c3d98e, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2e3f8176a86a4ddebc91195b55570bbe, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/8a4c69cae4b647b99bff94728b9034fb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/a9dadd3a5468435b8489109154e04b2f_SeqId_44_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp, totalSize=50.2 K 2023-10-31 05:52:59,025 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 3661dea099da414bab947a7b863ce14a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-31 05:52:59,025 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 5dd8afedd8e144c79c3e04111fedf330, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-31 05:52:59,025 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 3d7ed569e3a644d3b6a6979259d7c656, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-31 05:52:59,025 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 0ff7d04e3b244b2fa579a07936ea8562, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-31 05:52:59,025 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 1d9d78c19e2146d9a45a59a4cd62869d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-31 05:52:59,025 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting e9514270dfa64796bacfa1ac41575001, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-31 05:52:59,025 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 698df8ae86494ddca658b45991c3d98e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-31 05:52:59,026 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 2e3f8176a86a4ddebc91195b55570bbe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-31 05:52:59,026 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 8a4c69cae4b647b99bff94728b9034fb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-31 05:52:59,026 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting a9dadd3a5468435b8489109154e04b2f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-31 05:52:59,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-31 05:52:59,044 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:52:59,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122899188f090a144af59fb20f8f567723d7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122899188f090a144af59fb20f8f567723d7 2023-10-31 05:52:59,054 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a2b616117a154a72bb2248fda6936a5a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a2b616117a154a72bb2248fda6936a5a 2023-10-31 05:52:59,056 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101bb286e8c03c04907af86fc5821d7af49 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101bb286e8c03c04907af86fc5821d7af49 2023-10-31 05:52:59,057 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103cf4c9a9faeac4f3fa4e841d4efb6a7e2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103cf4c9a9faeac4f3fa4e841d4efb6a7e2 2023-10-31 05:52:59,058 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-10-31 05:52:59,058 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-31 05:52:59,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:52:59,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:52:59,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:52:59,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:52:59,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:52:59,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:52:59,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:52:59,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:52:59,109 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): e848040dfe4476a52f6685d5355a71be#family1#compaction#10 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:52:59,167 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/e431d0fb59e54d6a91c745a2be93cf40 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e431d0fb59e54d6a91c745a2be93cf40 2023-10-31 05:52:59,194 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e848040dfe4476a52f6685d5355a71be/family1 of e848040dfe4476a52f6685d5355a71be into e431d0fb59e54d6a91c745a2be93cf40(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:52:59,194 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:59,206 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1698731579021; duration=0sec 2023-10-31 05:52:59,208 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:52:59,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3661dea099da414bab947a7b863ce14a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/5dd8afedd8e144c79c3e04111fedf330, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3d7ed569e3a644d3b6a6979259d7c656, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/0ff7d04e3b244b2fa579a07936ea8562, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/1d9d78c19e2146d9a45a59a4cd62869d, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e9514270dfa64796bacfa1ac41575001, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/698df8ae86494ddca658b45991c3d98e, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2e3f8176a86a4ddebc91195b55570bbe, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/8a4c69cae4b647b99bff94728b9034fb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/a9dadd3a5468435b8489109154e04b2f_SeqId_44_] to archive 2023-10-31 05:52:59,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:52:59,217 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f935a4c55f4b481fae8ffa93eeb25c4f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f935a4c55f4b481fae8ffa93eeb25c4f 2023-10-31 05:52:59,219 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-31 05:52:59,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3661dea099da414bab947a7b863ce14a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3661dea099da414bab947a7b863ce14a 2023-10-31 05:52:59,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/5dd8afedd8e144c79c3e04111fedf330 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/5dd8afedd8e144c79c3e04111fedf330 2023-10-31 05:52:59,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3d7ed569e3a644d3b6a6979259d7c656 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/3d7ed569e3a644d3b6a6979259d7c656 2023-10-31 05:52:59,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/0ff7d04e3b244b2fa579a07936ea8562 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/0ff7d04e3b244b2fa579a07936ea8562 2023-10-31 05:52:59,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/1d9d78c19e2146d9a45a59a4cd62869d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/1d9d78c19e2146d9a45a59a4cd62869d 2023-10-31 05:52:59,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e9514270dfa64796bacfa1ac41575001 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e9514270dfa64796bacfa1ac41575001 2023-10-31 05:52:59,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/698df8ae86494ddca658b45991c3d98e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/698df8ae86494ddca658b45991c3d98e 2023-10-31 05:52:59,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2e3f8176a86a4ddebc91195b55570bbe to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2e3f8176a86a4ddebc91195b55570bbe 2023-10-31 05:52:59,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/8a4c69cae4b647b99bff94728b9034fb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/8a4c69cae4b647b99bff94728b9034fb 2023-10-31 05:52:59,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/a9dadd3a5468435b8489109154e04b2f_SeqId_44_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/a9dadd3a5468435b8489109154e04b2f_SeqId_44_ 2023-10-31 05:52:59,265 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2b13af77bf4a4abf8cb0ea1099ba2d24 first=Optional[r00] last=Optional[r2] 2023-10-31 05:52:59,268 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2b13af77bf4a4abf8cb0ea1099ba2d24}] 2023-10-31 05:52:59,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2b13af77bf4a4abf8cb0ea1099ba2d24 for inclusion in e848040dfe4476a52f6685d5355a71be/family1 2023-10-31 05:52:59,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-31 05:52:59,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:52:59,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:59,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2b13af77bf4a4abf8cb0ea1099ba2d24 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__psu2s402qkns7gnmdbr315mocr2mu1r7kaci2hs5o36p9l3kks9u6nds4i44b2nf/family1/2b13af77bf4a4abf8cb0ea1099ba2d24 2023-10-31 05:52:59,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__psu2s402qkns7gnmdbr315mocr2mu1r7kaci2hs5o36p9l3kks9u6nds4i44b2nf/family1/2b13af77bf4a4abf8cb0ea1099ba2d24 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/407d205f29444bac97cbdb495f81ffb3_SeqId_47_ 2023-10-31 05:52:59,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__psu2s402qkns7gnmdbr315mocr2mu1r7kaci2hs5o36p9l3kks9u6nds4i44b2nf/family1/2b13af77bf4a4abf8cb0ea1099ba2d24 into e848040dfe4476a52f6685d5355a71be/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/407d205f29444bac97cbdb495f81ffb3_SeqId_47_ - updating store file list. 2023-10-31 05:52:59,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/407d205f29444bac97cbdb495f81ffb3_SeqId_47_ into e848040dfe4476a52f6685d5355a71be/family1 2023-10-31 05:52:59,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__psu2s402qkns7gnmdbr315mocr2mu1r7kaci2hs5o36p9l3kks9u6nds4i44b2nf/family1/2b13af77bf4a4abf8cb0ea1099ba2d24 into e848040dfe4476a52f6685d5355a71be/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/407d205f29444bac97cbdb495f81ffb3_SeqId_47_) 2023-10-31 05:52:59,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__psu2s402qkns7gnmdbr315mocr2mu1r7kaci2hs5o36p9l3kks9u6nds4i44b2nf/family1/2b13af77bf4a4abf8cb0ea1099ba2d24 2023-10-31 05:52:59,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-31 05:52:59,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-31 05:52:59,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): e848040dfe4476a52f6685d5355a71be/family1 is initiating minor compaction (all files) 2023-10-31 05:52:59,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@142dc605; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:52:59,293 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e848040dfe4476a52f6685d5355a71be/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:59,294 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2450fd8a81c541058b44987f966acdbb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e431d0fb59e54d6a91c745a2be93cf40, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/407d205f29444bac97cbdb495f81ffb3_SeqId_47_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp, totalSize=358.6 K 2023-10-31 05:52:59,295 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 2450fd8a81c541058b44987f966acdbb, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878848969 2023-10-31 05:52:59,296 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting e431d0fb59e54d6a91c745a2be93cf40, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621248969 2023-10-31 05:52:59,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-31 05:52:59,298 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 407d205f29444bac97cbdb495f81ffb3_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878848969 2023-10-31 05:52:59,299 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:52:59,302 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113045753e34eb3e417aba54059960f72ac7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113045753e34eb3e417aba54059960f72ac7 2023-10-31 05:52:59,304 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014bf064a4dff246339c8135f02027ab3d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014bf064a4dff246339c8135f02027ab3d 2023-10-31 05:52:59,306 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056744b93a385e459491b7340f7765ac06 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056744b93a385e459491b7340f7765ac06 2023-10-31 05:52:59,306 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-10-31 05:52:59,306 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-31 05:52:59,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:52:59,307 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-31 05:52:59,308 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:52:59,309 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-31 05:52:59,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.1070 sec 2023-10-31 05:52:59,342 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): e848040dfe4476a52f6685d5355a71be#family1#compaction#11 average throughput is 6.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:52:59,404 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/.tmp/family1/ceaa2de8b20f4c0d90ecb49b1cc2583c as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/ceaa2de8b20f4c0d90ecb49b1cc2583c 2023-10-31 05:52:59,418 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e848040dfe4476a52f6685d5355a71be/family1 of e848040dfe4476a52f6685d5355a71be into ceaa2de8b20f4c0d90ecb49b1cc2583c(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:52:59,418 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:59,418 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1698731579293; duration=0sec 2023-10-31 05:52:59,418 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:52:59,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2450fd8a81c541058b44987f966acdbb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e431d0fb59e54d6a91c745a2be93cf40, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/407d205f29444bac97cbdb495f81ffb3_SeqId_47_] to archive 2023-10-31 05:52:59,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:52:59,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-31 05:52:59,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2450fd8a81c541058b44987f966acdbb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/2450fd8a81c541058b44987f966acdbb 2023-10-31 05:52:59,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e431d0fb59e54d6a91c745a2be93cf40 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/e431d0fb59e54d6a91c745a2be93cf40 2023-10-31 05:52:59,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/407d205f29444bac97cbdb495f81ffb3_SeqId_47_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/407d205f29444bac97cbdb495f81ffb3_SeqId_47_ 2023-10-31 05:52:59,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:52:59,523 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-31 05:52:59,525 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-31 05:52:59,525 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-31 05:52:59,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-10-31 05:52:59,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e848040dfe4476a52f6685d5355a71be, REOPEN/MOVE}] 2023-10-31 05:52:59,543 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e848040dfe4476a52f6685d5355a71be, REOPEN/MOVE 2023-10-31 05:52:59,544 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e848040dfe4476a52f6685d5355a71be, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:59,545 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698731579544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731579544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731579544"}]},"ts":"1698731579544"} 2023-10-31 05:52:59,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure e848040dfe4476a52f6685d5355a71be, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:52:59,706 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:59,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:59,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e848040dfe4476a52f6685d5355a71be, disabling compactions & flushes 2023-10-31 05:52:59,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:59,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:59,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. after waiting 0 ms 2023-10-31 05:52:59,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:59,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-31 05:52:59,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:52:59,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:52:59,716 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: e848040dfe4476a52f6685d5355a71be to self. 2023-10-31 05:52:59,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e848040dfe4476a52f6685d5355a71be 2023-10-31 05:52:59,719 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e848040dfe4476a52f6685d5355a71be, regionState=CLOSED 2023-10-31 05:52:59,719 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698731579719"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731579719"}]},"ts":"1698731579719"} 2023-10-31 05:52:59,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-10-31 05:52:59,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure e848040dfe4476a52f6685d5355a71be, server=jenkins-hbase20.apache.org,43723,1698731565849 in 173 msec 2023-10-31 05:52:59,725 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e848040dfe4476a52f6685d5355a71be, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=true 2023-10-31 05:52:59,875 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e848040dfe4476a52f6685d5355a71be, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:52:59,876 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698731579875"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731579875"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731579875"}]},"ts":"1698731579875"} 2023-10-31 05:52:59,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure e848040dfe4476a52f6685d5355a71be, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:00,031 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:00,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:53:00,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e848040dfe4476a52f6685d5355a71be, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:53:00,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly e848040dfe4476a52f6685d5355a71be 2023-10-31 05:53:00,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:00,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e848040dfe4476a52f6685d5355a71be 2023-10-31 05:53:00,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e848040dfe4476a52f6685d5355a71be 2023-10-31 05:53:00,038 INFO [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e848040dfe4476a52f6685d5355a71be 2023-10-31 05:53:00,039 DEBUG [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1 2023-10-31 05:53:00,039 DEBUG [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1 2023-10-31 05:53:00,040 INFO [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e848040dfe4476a52f6685d5355a71be columnFamilyName family1 2023-10-31 05:53:00,048 DEBUG [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/ceaa2de8b20f4c0d90ecb49b1cc2583c 2023-10-31 05:53:00,049 INFO [StoreOpener-e848040dfe4476a52f6685d5355a71be-1] regionserver.HStore(310): Store=e848040dfe4476a52f6685d5355a71be/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:00,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be 2023-10-31 05:53:00,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be 2023-10-31 05:53:00,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e848040dfe4476a52f6685d5355a71be 2023-10-31 05:53:00,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e848040dfe4476a52f6685d5355a71be; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59708251, jitterRate=-0.11027772724628448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:53:00,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:53:00,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be., pid=17, masterSystemTime=1698731580031 2023-10-31 05:53:00,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:53:00,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:53:00,062 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e848040dfe4476a52f6685d5355a71be, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:00,063 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698731580062"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731580062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731580062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731580062"}]},"ts":"1698731580062"} 2023-10-31 05:53:00,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-10-31 05:53:00,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure e848040dfe4476a52f6685d5355a71be, server=jenkins-hbase20.apache.org,43723,1698731565849 in 187 msec 2023-10-31 05:53:00,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-31 05:53:00,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e848040dfe4476a52f6685d5355a71be, REOPEN/MOVE in 526 msec 2023-10-31 05:53:00,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-10-31 05:53:00,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 544 msec 2023-10-31 05:53:00,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 573 msec 2023-10-31 05:53:00,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-10-31 05:53:00,088 INFO [Listener at localhost/40291] compactions.TestMobCompactor(278): alter status finished 2023-10-31 05:53:00,090 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-31 05:53:00,096 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:00,097 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:00,099 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:00,099 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732180099 2023-10-31 05:53:00,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:53:00,101 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-31 05:53:00,101 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-31 05:53:00,103 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x563db2dc to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:53:00,109 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5379594c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:53:00,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:53:00,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:53:00,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:53:00,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:53:00,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:53:00,555 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112846e47b5ea9b745379f96ea6734c04e61 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112846e47b5ea9b745379f96ea6734c04e61 2023-10-31 05:53:00,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-31 05:53:00,569 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:53:00,571 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:53:00,581 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:53:00,583 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:53:00,598 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ba1a6afdf5634bab83ba347f2bc3978b first=Optional[r05] last=Optional[r8] 2023-10-31 05:53:00,599 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=51 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ba1a6afdf5634bab83ba347f2bc3978b}] 2023-10-31 05:53:00,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ba1a6afdf5634bab83ba347f2bc3978b for inclusion in e848040dfe4476a52f6685d5355a71be/family1 2023-10-31 05:53:00,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-31 05:53:00,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:00,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:53:00,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ba1a6afdf5634bab83ba347f2bc3978b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h67f705t0qgvuh94vhpnu4cla8jt1s8g6vie1a68gs47dv7veg5qftqkcb4pigao/family1/ba1a6afdf5634bab83ba347f2bc3978b 2023-10-31 05:53:00,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h67f705t0qgvuh94vhpnu4cla8jt1s8g6vie1a68gs47dv7veg5qftqkcb4pigao/family1/ba1a6afdf5634bab83ba347f2bc3978b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/ca8626a0e53645f2a7f31aa5f3c93e3d_SeqId_53_ 2023-10-31 05:53:00,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h67f705t0qgvuh94vhpnu4cla8jt1s8g6vie1a68gs47dv7veg5qftqkcb4pigao/family1/ba1a6afdf5634bab83ba347f2bc3978b into e848040dfe4476a52f6685d5355a71be/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/ca8626a0e53645f2a7f31aa5f3c93e3d_SeqId_53_ - updating store file list. 2023-10-31 05:53:00,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/ca8626a0e53645f2a7f31aa5f3c93e3d_SeqId_53_ into e848040dfe4476a52f6685d5355a71be/family1 2023-10-31 05:53:00,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h67f705t0qgvuh94vhpnu4cla8jt1s8g6vie1a68gs47dv7veg5qftqkcb4pigao/family1/ba1a6afdf5634bab83ba347f2bc3978b into e848040dfe4476a52f6685d5355a71be/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/family1/ca8626a0e53645f2a7f31aa5f3c93e3d_SeqId_53_) 2023-10-31 05:53:00,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h67f705t0qgvuh94vhpnu4cla8jt1s8g6vie1a68gs47dv7veg5qftqkcb4pigao/family1/ba1a6afdf5634bab83ba347f2bc3978b 2023-10-31 05:53:00,629 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-31 05:53:00,630 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:00,632 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112068dbccd8dcb14cf8be1da06fa430169a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112068dbccd8dcb14cf8be1da06fa430169a 2023-10-31 05:53:00,634 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e594a595c932452d8268735db359eab0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e594a595c932452d8268735db359eab0 2023-10-31 05:53:00,634 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-10-31 05:53:00,634 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-31 05:53:00,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:53:00,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:53:00,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-31 05:53:00,635 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-31 05:53:00,635 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:00,636 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:00,638 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 546 msec 2023-10-31 05:53:00,729 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=253 (was 212) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:41110 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26d2b4b3-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:41080 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64652@0x5f8a9a4d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:40894 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64652@0x563db2dc-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:41032 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase20:43723-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:40954 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64652@0x563db2dc sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1423847649.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:40820 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:40862 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:40978 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:40934 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64652@0x563db2dc-SendThread(127.0.0.1:64652) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x26d2b4b3-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26d2b4b3-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73f6cda4-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2052209940_17 at /127.0.0.1:40990 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64652@0x5f8a9a4d sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1423847649.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:41152 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:41060 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:41024 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:41096 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64652@0x5f8a9a4d-SendThread(127.0.0.1:64652) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:40996 [Waiting for operation #25] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:40838 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:40962 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73f6cda4-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73f6cda4-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26d2b4b3-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x26d2b4b3-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=607 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=354 (was 317) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=2190 (was 2251) 2023-10-31 05:53:00,741 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=253, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=354, ProcessCount=169, AvailableMemoryMB=2189 2023-10-31 05:53:00,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-31 05:53:00,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:00,747 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:53:00,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-10-31 05:53:00,748 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:53:00,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-31 05:53:00,750 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0 2023-10-31 05:53:00,751 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0 empty. 2023-10-31 05:53:00,752 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0 2023-10-31 05:53:00,752 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-10-31 05:53:00,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-31 05:53:01,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-31 05:53:01,162 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-31 05:53:01,165 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 72f3bdf4e34390e87c32328650f148d0, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:53:01,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-31 05:53:01,578 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:01,578 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 72f3bdf4e34390e87c32328650f148d0, disabling compactions & flushes 2023-10-31 05:53:01,578 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:01,579 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:01,579 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. after waiting 0 ms 2023-10-31 05:53:01,579 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:01,579 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:01,579 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:01,582 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:53:01,583 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698731581583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731581583"}]},"ts":"1698731581583"} 2023-10-31 05:53:01,586 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-31 05:53:01,587 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:53:01,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731581587"}]},"ts":"1698731581587"} 2023-10-31 05:53:01,590 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-31 05:53:01,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=72f3bdf4e34390e87c32328650f148d0, ASSIGN}] 2023-10-31 05:53:01,595 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=72f3bdf4e34390e87c32328650f148d0, ASSIGN 2023-10-31 05:53:01,596 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=72f3bdf4e34390e87c32328650f148d0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:53:01,747 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=72f3bdf4e34390e87c32328650f148d0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:01,748 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698731581747"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731581747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731581747"}]},"ts":"1698731581747"} 2023-10-31 05:53:01,750 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 72f3bdf4e34390e87c32328650f148d0, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:01,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-31 05:53:01,902 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:01,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:01,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 72f3bdf4e34390e87c32328650f148d0, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:53:01,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 72f3bdf4e34390e87c32328650f148d0 2023-10-31 05:53:01,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:01,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 72f3bdf4e34390e87c32328650f148d0 2023-10-31 05:53:01,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 72f3bdf4e34390e87c32328650f148d0 2023-10-31 05:53:01,909 INFO [StoreOpener-72f3bdf4e34390e87c32328650f148d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 72f3bdf4e34390e87c32328650f148d0 2023-10-31 05:53:01,911 DEBUG [StoreOpener-72f3bdf4e34390e87c32328650f148d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1 2023-10-31 05:53:01,911 DEBUG [StoreOpener-72f3bdf4e34390e87c32328650f148d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1 2023-10-31 05:53:01,911 INFO [StoreOpener-72f3bdf4e34390e87c32328650f148d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72f3bdf4e34390e87c32328650f148d0 columnFamilyName family1 2023-10-31 05:53:01,913 INFO [StoreOpener-72f3bdf4e34390e87c32328650f148d0-1] regionserver.HStore(310): Store=72f3bdf4e34390e87c32328650f148d0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:01,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0 2023-10-31 05:53:01,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0 2023-10-31 05:53:01,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 72f3bdf4e34390e87c32328650f148d0 2023-10-31 05:53:01,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:53:01,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 72f3bdf4e34390e87c32328650f148d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60111474, jitterRate=-0.10426923632621765}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:53:01,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:01,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0., pid=21, masterSystemTime=1698731581902 2023-10-31 05:53:01,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:01,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:01,925 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=72f3bdf4e34390e87c32328650f148d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:01,925 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698731581925"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731581925"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731581925"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731581925"}]},"ts":"1698731581925"} 2023-10-31 05:53:01,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-10-31 05:53:01,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 72f3bdf4e34390e87c32328650f148d0, server=jenkins-hbase20.apache.org,43723,1698731565849 in 177 msec 2023-10-31 05:53:01,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-10-31 05:53:01,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=72f3bdf4e34390e87c32328650f148d0, ASSIGN in 337 msec 2023-10-31 05:53:01,932 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:53:01,933 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731581932"}]},"ts":"1698731581932"} 2023-10-31 05:53:01,934 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-31 05:53:01,936 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:53:01,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1920 sec 2023-10-31 05:53:02,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-31 05:53:02,856 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-10-31 05:53:02,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:02,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:02,898 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:02,898 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:02,898 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:53:02,898 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:02,899 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:02,899 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:02,900 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:02,900 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:02,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:02,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:02,900 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:02,900 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:02,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:02,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:02,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:02,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:02,901 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:02,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:02,901 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:53:02,901 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:02,902 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:53:02,902 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:02,902 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:02,902 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:02,902 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. started... 2023-10-31 05:53:02,902 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72f3bdf4e34390e87c32328650f148d0 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-31 05:53:03,336 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113043c9a353197846b0b9fa2ef1e7bd54f8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113043c9a353197846b0b9fa2ef1e7bd54f8 2023-10-31 05:53:03,742 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/634a4f961a664543aaa8198a23b3906b 2023-10-31 05:53:03,750 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/634a4f961a664543aaa8198a23b3906b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/634a4f961a664543aaa8198a23b3906b 2023-10-31 05:53:03,757 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/634a4f961a664543aaa8198a23b3906b, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-31 05:53:03,759 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 72f3bdf4e34390e87c32328650f148d0 in 857ms, sequenceid=5, compaction requested=false 2023-10-31 05:53:03,759 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:03,760 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:03,760 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:03,760 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:03,760 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:03,760 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,761 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:53:03,761 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:53:03,762 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,762 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:03,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:03,763 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:03,763 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:03,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:53:03,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@632246c6[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:03,764 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:03,764 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,765 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,765 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:03,765 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:53:03,765 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:03,765 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,765 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:03,766 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:53:03,766 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,766 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:03,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:03,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:03,766 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:53:03,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:03,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:03,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:03,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:03,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:03,769 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:53:03,769 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:03,769 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:03,769 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,769 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:03,770 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,770 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:03,770 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:03,771 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,772 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,774 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,774 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,774 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,774 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:03,774 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:03,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:03,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:03,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:53:03,774 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,774 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:03,774 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:03,774 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:03,775 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:03,774 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:03,775 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:03,875 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:03,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:03,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:03,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:03,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,885 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:03,885 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:03,886 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:53:03,886 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:03,887 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,887 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,888 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:03,888 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:03,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:03,888 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:03,888 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:03,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:03,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,889 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,889 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:53:03,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:03,889 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:53:03,889 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:03,890 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:53:03,890 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:03,890 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:03,890 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:03,890 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. started... 2023-10-31 05:53:03,890 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72f3bdf4e34390e87c32328650f148d0 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-31 05:53:03,905 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285745e8c8ae1f49a48a13b7ee3f42661d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511285745e8c8ae1f49a48a13b7ee3f42661d 2023-10-31 05:53:04,311 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/087223eda5b143f8a40c70e904738cc0 2023-10-31 05:53:04,319 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/087223eda5b143f8a40c70e904738cc0 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/087223eda5b143f8a40c70e904738cc0 2023-10-31 05:53:04,326 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/087223eda5b143f8a40c70e904738cc0, entries=1, sequenceid=9, filesize=5.0 K 2023-10-31 05:53:04,327 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 72f3bdf4e34390e87c32328650f148d0 in 437ms, sequenceid=9, compaction requested=false 2023-10-31 05:53:04,327 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:04,327 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:04,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:04,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:04,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:53:04,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:53:04,339 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,339 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:04,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:04,339 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,340 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:04,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:04,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:04,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:53:04,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18696d22[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:04,342 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:04,342 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,343 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,344 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:04,344 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:53:04,344 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,344 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:04,344 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:04,345 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,345 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:53:04,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:04,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:04,345 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:04,346 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:53:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:04,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:04,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:04,349 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:53:04,349 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:04,349 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:04,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:04,349 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,349 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:04,351 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,351 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:04,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:04,351 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:04,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:04,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:04,351 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:04,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:04,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,352 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,359 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,359 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:04,359 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:04,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:04,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:04,359 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:04,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:53:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:04,359 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:04,359 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,360 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,360 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:04,360 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:04,360 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:04,360 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:04,360 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,461 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:04,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:04,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:04,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:04,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,476 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:04,476 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:04,477 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:53:04,477 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:04,477 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,477 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,478 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:04,478 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:04,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:04,479 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:04,479 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:04,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,480 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,480 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:53:04,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:53:04,480 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:04,481 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:53:04,481 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:04,481 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:04,481 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:04,481 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. started... 2023-10-31 05:53:04,481 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72f3bdf4e34390e87c32328650f148d0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:04,899 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019c27b73c89fc4c6584fb0295374fd670 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512019c27b73c89fc4c6584fb0295374fd670 2023-10-31 05:53:05,242 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:53:05,306 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/df05b12cf42d46759c6a385f656c3603 2023-10-31 05:53:05,316 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/df05b12cf42d46759c6a385f656c3603 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/df05b12cf42d46759c6a385f656c3603 2023-10-31 05:53:05,323 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/df05b12cf42d46759c6a385f656c3603, entries=1, sequenceid=13, filesize=4.9 K 2023-10-31 05:53:05,325 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 72f3bdf4e34390e87c32328650f148d0 in 844ms, sequenceid=13, compaction requested=true 2023-10-31 05:53:05,325 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:05,325 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:05,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:05,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:05,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:53:05,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:53:05,327 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:05,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:05,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:05,328 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:05,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:53:05,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ac1780[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:05,329 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:05,329 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,330 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:53:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:05,331 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,331 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:05,332 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,332 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:53:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:05,332 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:05,332 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:53:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:05,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:05,338 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:53:05,338 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:05,338 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:05,338 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,338 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:05,356 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,356 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:05,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,356 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:05,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:05,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,362 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:05,364 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,367 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:05,368 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:05,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:05,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:05,368 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:05,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:05,368 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:05,368 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,369 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,370 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,370 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,370 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,370 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,370 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:05,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:53:05,370 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:05,470 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:05,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:05,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:05,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:05,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,487 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:05,487 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:05,488 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:53:05,488 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:05,489 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,489 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,490 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:05,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:05,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:05,491 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,491 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,491 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,492 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,492 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:53:05,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:53:05,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:05,493 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:53:05,493 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:05,493 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:05,493 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:05,493 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. started... 2023-10-31 05:53:05,493 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72f3bdf4e34390e87c32328650f148d0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:05,529 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205266186be338e4dba96cc468e8c8c6b6f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205266186be338e4dba96cc468e8c8c6b6f 2023-10-31 05:53:05,945 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/7507b183536f4ad2b66c7c091e83bf33 2023-10-31 05:53:05,953 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/7507b183536f4ad2b66c7c091e83bf33 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7507b183536f4ad2b66c7c091e83bf33 2023-10-31 05:53:05,960 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7507b183536f4ad2b66c7c091e83bf33, entries=1, sequenceid=17, filesize=4.9 K 2023-10-31 05:53:05,962 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 72f3bdf4e34390e87c32328650f148d0 in 469ms, sequenceid=17, compaction requested=true 2023-10-31 05:53:05,962 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:05,962 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:05,962 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:05,962 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:05,962 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,962 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:53:05,962 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:53:05,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,967 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:05,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:05,968 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,968 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:05,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:05,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:05,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:05,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:53:05,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f95e006[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:05,970 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:05,970 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,972 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,972 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:05,972 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:53:05,972 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:05,972 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,973 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:05,973 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:53:05,973 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:05,973 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,973 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:53:05,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:05,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:05,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:05,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:05,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:05,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:05,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:05,984 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:53:05,984 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:05,984 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:05,984 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,984 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:05,986 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,986 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,986 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:05,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:05,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:05,987 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:05,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:05,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:05,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:05,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,989 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:05,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,998 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:05,998 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:05,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:05,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:05,998 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,998 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:53:05,998 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:05,998 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,998 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:05,999 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,999 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:05,999 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:06,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:06,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:06,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:06,001 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:06,001 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:06,101 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:06,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:06,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:06,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:06,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,113 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:06,113 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:06,114 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:53:06,114 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:06,114 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,114 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,115 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:06,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:06,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:06,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:06,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,116 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,117 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:53:06,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,117 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:53:06,117 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:06,117 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:06,117 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:53:06,118 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:06,118 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:06,119 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:06,119 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:06,129 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:06,129 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. started... 2023-10-31 05:53:06,129 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72f3bdf4e34390e87c32328650f148d0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:06,560 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281c524e3a4fe44c1c90a8c69dc88c8e24 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512281c524e3a4fe44c1c90a8c69dc88c8e24 2023-10-31 05:53:06,969 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/6419b2fd54604939b7bd7d50adcd0c31 2023-10-31 05:53:06,977 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/6419b2fd54604939b7bd7d50adcd0c31 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6419b2fd54604939b7bd7d50adcd0c31 2023-10-31 05:53:06,984 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6419b2fd54604939b7bd7d50adcd0c31, entries=1, sequenceid=21, filesize=4.9 K 2023-10-31 05:53:06,986 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 72f3bdf4e34390e87c32328650f148d0 in 857ms, sequenceid=21, compaction requested=true 2023-10-31 05:53:06,986 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:06,986 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:06,986 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:06,986 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:06,986 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:06,987 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:53:06,987 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:53:06,988 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:06,988 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:06,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:06,989 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,989 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:06,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:06,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:53:06,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e709f44[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:06,993 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:06,993 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,997 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:06,998 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:06,998 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:53:06,998 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:06,999 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:53:06,999 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:06,999 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:53:07,001 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,001 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:07,001 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:07,001 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:53:07,001 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:07,001 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:07,001 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,001 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:07,004 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,004 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:07,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,004 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:07,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:07,007 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,009 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,014 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:07,015 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,015 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,015 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,015 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,015 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,015 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,015 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,015 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:07,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:07,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:07,016 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:07,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:07,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:07,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:07,017 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:07,017 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:07,117 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:07,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:07,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:07,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:07,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,127 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:07,128 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:07,128 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:53:07,128 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:07,129 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,129 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,130 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,130 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:07,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:07,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:07,130 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,130 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:07,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:07,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,131 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,131 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:53:07,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:53:07,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:07,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:53:07,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:07,132 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:07,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:07,132 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. started... 2023-10-31 05:53:07,132 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72f3bdf4e34390e87c32328650f148d0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:07,563 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123131727e923a0f47f2883f2d8c5f9fa38e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123131727e923a0f47f2883f2d8c5f9fa38e 2023-10-31 05:53:07,973 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/ceab61f8f3e742bb95b3bf1d096b416c 2023-10-31 05:53:07,980 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/ceab61f8f3e742bb95b3bf1d096b416c as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/ceab61f8f3e742bb95b3bf1d096b416c 2023-10-31 05:53:07,987 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/ceab61f8f3e742bb95b3bf1d096b416c, entries=1, sequenceid=25, filesize=4.9 K 2023-10-31 05:53:07,989 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 72f3bdf4e34390e87c32328650f148d0 in 857ms, sequenceid=25, compaction requested=true 2023-10-31 05:53:07,989 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:07,989 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:07,989 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:07,989 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:07,989 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,989 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:53:07,989 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:53:07,991 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,991 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:07,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:07,992 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,992 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:07,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:07,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:07,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:07,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:53:07,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d23e1d5[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:07,993 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:07,993 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,994 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,994 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:07,994 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,994 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:07,994 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:53:07,994 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:07,995 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:53:07,995 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,995 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:07,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:07,995 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:53:07,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:07,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:07,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:07,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:07,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:07,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:07,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:07,998 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:53:07,998 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:07,998 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:07,998 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,998 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:07,999 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,999 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:08,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:07,999 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:08,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:08,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:08,000 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,004 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:08,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,006 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,006 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,006 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,006 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,007 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,007 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:08,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:08,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:08,007 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,007 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:08,007 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:08,007 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:08,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:08,007 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:08,007 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:08,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:08,108 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:08,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:08,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:08,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:08,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,117 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:08,117 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:08,118 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:53:08,118 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:08,119 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,119 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,120 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:08,120 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:08,120 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,120 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,121 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,121 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:53:08,121 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,122 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:53:08,122 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:08,122 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:53:08,125 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:08,125 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:08,125 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:08,125 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. started... 2023-10-31 05:53:08,125 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72f3bdf4e34390e87c32328650f148d0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:08,544 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a96423b079ea462b8d83d187b673fdae to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a96423b079ea462b8d83d187b673fdae 2023-10-31 05:53:08,952 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/5b5194830df54a47bd181792340ccc44 2023-10-31 05:53:08,964 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/5b5194830df54a47bd181792340ccc44 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/5b5194830df54a47bd181792340ccc44 2023-10-31 05:53:08,970 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/5b5194830df54a47bd181792340ccc44, entries=1, sequenceid=29, filesize=4.9 K 2023-10-31 05:53:08,971 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 72f3bdf4e34390e87c32328650f148d0 in 846ms, sequenceid=29, compaction requested=true 2023-10-31 05:53:08,971 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:08,971 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:08,971 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:08,971 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:08,971 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,972 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:53:08,972 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:53:08,973 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,973 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:08,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:08,973 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,973 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:08,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:08,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:08,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:08,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:53:08,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c52efe6[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:08,974 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:08,975 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,975 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,975 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:08,975 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:53:08,975 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:08,975 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,975 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:08,976 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,976 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:53:08,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:08,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:08,976 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:08,976 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:53:08,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:08,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:08,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:08,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:08,979 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:53:08,979 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:08,979 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:08,979 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,979 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:08,980 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,980 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,980 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:08,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:08,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:08,980 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:08,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,981 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,983 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,983 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,983 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:08,983 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,983 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:08,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:08,983 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:08,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:08,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:08,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:53:08,983 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:08,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:08,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:08,984 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,984 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,984 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:08,984 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:08,984 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:09,084 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:09,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:09,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:09,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:09,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,101 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:09,101 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:09,101 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:53:09,101 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:09,102 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,102 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,103 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:09,103 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:09,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:09,103 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,103 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:09,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:09,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,104 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,104 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:53:09,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,105 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:53:09,105 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:09,106 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:53:09,106 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:09,106 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:09,106 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:09,106 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. started... 2023-10-31 05:53:09,106 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72f3bdf4e34390e87c32328650f148d0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:09,529 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103881aaf0272094118bcb84475781ef5ed to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103881aaf0272094118bcb84475781ef5ed 2023-10-31 05:53:09,937 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/c902c4ddf2ec4d39afd8b4145bc72fec 2023-10-31 05:53:09,947 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/c902c4ddf2ec4d39afd8b4145bc72fec as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/c902c4ddf2ec4d39afd8b4145bc72fec 2023-10-31 05:53:09,955 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/c902c4ddf2ec4d39afd8b4145bc72fec, entries=1, sequenceid=33, filesize=4.9 K 2023-10-31 05:53:09,956 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 72f3bdf4e34390e87c32328650f148d0 in 850ms, sequenceid=33, compaction requested=true 2023-10-31 05:53:09,956 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:09,956 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:09,956 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:09,956 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:09,957 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,957 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:53:09,957 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:53:09,958 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,958 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:09,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:09,958 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,958 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:09,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:09,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:09,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:09,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:53:09,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c87afba[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:09,960 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:09,960 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,964 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,965 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:09,965 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:53:09,965 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:09,965 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,965 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:09,965 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:53:09,965 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,965 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:09,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:09,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:09,966 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:53:09,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:09,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:09,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:09,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:09,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:09,969 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:53:09,969 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:09,969 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:09,969 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,969 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:09,971 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,971 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,971 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:09,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:09,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:09,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:09,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:09,972 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:09,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:09,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,973 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,976 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:09,976 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,976 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:09,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:09,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:09,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:09,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:53:09,976 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:09,976 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:09,977 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,977 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:09,977 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:09,977 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:09,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:09,977 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:09,978 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:09,978 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,078 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:10,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:10,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:10,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:10,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,090 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:10,090 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:10,091 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:53:10,091 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:10,092 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,092 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,093 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,093 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:10,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:10,094 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,094 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,095 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,095 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:53:10,095 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,095 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:53:10,095 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:10,096 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:53:10,096 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:10,096 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:10,096 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:10,096 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. started... 2023-10-31 05:53:10,096 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72f3bdf4e34390e87c32328650f148d0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:10,521 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907dc647dd9f6034ed6a8a9da1f017435f2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907dc647dd9f6034ed6a8a9da1f017435f2 2023-10-31 05:53:10,930 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/7f7374ee24584225b0d8dfb0c3e1cd74 2023-10-31 05:53:10,937 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/7f7374ee24584225b0d8dfb0c3e1cd74 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7f7374ee24584225b0d8dfb0c3e1cd74 2023-10-31 05:53:10,944 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7f7374ee24584225b0d8dfb0c3e1cd74, entries=1, sequenceid=37, filesize=4.9 K 2023-10-31 05:53:10,945 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 72f3bdf4e34390e87c32328650f148d0 in 849ms, sequenceid=37, compaction requested=true 2023-10-31 05:53:10,946 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:10,946 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:10,946 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:10,946 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:10,946 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,946 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:53:10,946 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:53:10,947 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,947 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:10,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:10,948 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,948 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:10,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:10,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:10,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:10,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:53:10,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@769797d1[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:10,949 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:10,949 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,950 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,950 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:10,950 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:53:10,950 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:10,950 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,951 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:10,951 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:53:10,951 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:10,951 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,951 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:53:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:10,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:10,956 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:53:10,956 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:10,957 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:10,957 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,957 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:10,964 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,964 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:10,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,964 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:10,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:10,965 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,967 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,975 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,975 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:10,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:10,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:53:10,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:10,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:10,975 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:10,975 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:10,975 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:10,976 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,976 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:10,976 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,976 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,977 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:10,977 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:10,977 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:10,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:10,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:11,077 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:11,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:11,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:11,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:11,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,085 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:11,085 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:11,086 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:53:11,086 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:11,086 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,086 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,087 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,087 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:11,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:11,087 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,087 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,088 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,088 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:53:11,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,088 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:53:11,088 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:11,089 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:53:11,090 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:11,090 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:11,090 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:11,090 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. started... 2023-10-31 05:53:11,090 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 72f3bdf4e34390e87c32328650f148d0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:11,522 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d5f7acff71a6473e89b41e24f8b7e73d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120d5f7acff71a6473e89b41e24f8b7e73d 2023-10-31 05:53:11,929 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/4fde28992dda4fd0976926d727adbdee 2023-10-31 05:53:11,939 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/4fde28992dda4fd0976926d727adbdee as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/4fde28992dda4fd0976926d727adbdee 2023-10-31 05:53:11,946 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/4fde28992dda4fd0976926d727adbdee, entries=1, sequenceid=41, filesize=4.9 K 2023-10-31 05:53:11,947 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 72f3bdf4e34390e87c32328650f148d0 in 857ms, sequenceid=41, compaction requested=true 2023-10-31 05:53:11,948 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:11,948 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:11,948 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:11,948 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:11,948 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,948 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:53:11,948 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:53:11,949 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,949 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:11,950 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,950 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:11,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:11,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:53:11,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24e8ed9f[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:11,952 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:11,952 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,953 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,953 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:11,953 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,953 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:11,953 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:53:11,953 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:11,954 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,954 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:53:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:11,954 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:11,954 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:53:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:11,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:11,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:11,957 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:53:11,957 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:11,958 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:11,958 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,958 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:11,959 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,959 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,959 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:11,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:11,960 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,961 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,963 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,963 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:11,963 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:11,963 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:11,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:53:11,963 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:11,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-31 05:53:11,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:11,963 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,965 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:11,965 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,965 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,965 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:11,965 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:11,965 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:11,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:11,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:12,065 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:12,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:12,071 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-10-31 05:53:12,076 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:53:12,077 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:53:12,078 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732192078 2023-10-31 05:53:12,078 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:12,081 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:53:12,082 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-31 05:53:12,082 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:53:12,084 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x7b83933f to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:53:12,087 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3eddfa06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:53:12,087 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:53:12,929 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035a90709367c843ffaf593c51bb932367 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601035a90709367c843ffaf593c51bb932367 2023-10-31 05:53:12,930 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:53:12,947 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:53:12,948 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:53:12,956 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:53:12,957 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:53:12,971 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5a9b4969cb5b4fbc8adf5f5389b87ff4 first=Optional[r5] last=Optional[r6] 2023-10-31 05:53:12,971 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5a9b4969cb5b4fbc8adf5f5389b87ff4}] 2023-10-31 05:53:12,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5a9b4969cb5b4fbc8adf5f5389b87ff4 for inclusion in 72f3bdf4e34390e87c32328650f148d0/family1 2023-10-31 05:53:12,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-31 05:53:12,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:12,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:12,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5a9b4969cb5b4fbc8adf5f5389b87ff4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__plil6tdh1b9olueo6rgd17pmrj7boq9q66tetgvi9vo8sjbbdb8bk2s55dp6avsv/family1/5a9b4969cb5b4fbc8adf5f5389b87ff4 2023-10-31 05:53:12,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__plil6tdh1b9olueo6rgd17pmrj7boq9q66tetgvi9vo8sjbbdb8bk2s55dp6avsv/family1/5a9b4969cb5b4fbc8adf5f5389b87ff4 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/238598c14b534e639d5fa5b67ebe05f9_SeqId_44_ 2023-10-31 05:53:12,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__plil6tdh1b9olueo6rgd17pmrj7boq9q66tetgvi9vo8sjbbdb8bk2s55dp6avsv/family1/5a9b4969cb5b4fbc8adf5f5389b87ff4 into 72f3bdf4e34390e87c32328650f148d0/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/238598c14b534e639d5fa5b67ebe05f9_SeqId_44_ - updating store file list. 2023-10-31 05:53:12,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/238598c14b534e639d5fa5b67ebe05f9_SeqId_44_ into 72f3bdf4e34390e87c32328650f148d0/family1 2023-10-31 05:53:12,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__plil6tdh1b9olueo6rgd17pmrj7boq9q66tetgvi9vo8sjbbdb8bk2s55dp6avsv/family1/5a9b4969cb5b4fbc8adf5f5389b87ff4 into 72f3bdf4e34390e87c32328650f148d0/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/238598c14b534e639d5fa5b67ebe05f9_SeqId_44_) 2023-10-31 05:53:12,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__plil6tdh1b9olueo6rgd17pmrj7boq9q66tetgvi9vo8sjbbdb8bk2s55dp6avsv/family1/5a9b4969cb5b4fbc8adf5f5389b87ff4 2023-10-31 05:53:12,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-31 05:53:12,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-31 05:53:12,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): 72f3bdf4e34390e87c32328650f148d0/family1 is initiating minor compaction 2023-10-31 05:53:12,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@748c1e5e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:12,994 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 72f3bdf4e34390e87c32328650f148d0/family1 in testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:12,994 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/087223eda5b143f8a40c70e904738cc0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/df05b12cf42d46759c6a385f656c3603, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7507b183536f4ad2b66c7c091e83bf33, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6419b2fd54604939b7bd7d50adcd0c31, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/ceab61f8f3e742bb95b3bf1d096b416c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/5b5194830df54a47bd181792340ccc44, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/c902c4ddf2ec4d39afd8b4145bc72fec, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7f7374ee24584225b0d8dfb0c3e1cd74, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/4fde28992dda4fd0976926d727adbdee, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/238598c14b534e639d5fa5b67ebe05f9_SeqId_44_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp, totalSize=49.7 K 2023-10-31 05:53:12,995 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 087223eda5b143f8a40c70e904738cc0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-31 05:53:12,995 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting df05b12cf42d46759c6a385f656c3603, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-31 05:53:12,995 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 7507b183536f4ad2b66c7c091e83bf33, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-31 05:53:12,995 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 6419b2fd54604939b7bd7d50adcd0c31, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-31 05:53:12,995 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting ceab61f8f3e742bb95b3bf1d096b416c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-31 05:53:12,995 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 5b5194830df54a47bd181792340ccc44, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-31 05:53:12,995 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting c902c4ddf2ec4d39afd8b4145bc72fec, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-31 05:53:12,995 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 7f7374ee24584225b0d8dfb0c3e1cd74, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-31 05:53:12,995 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 4fde28992dda4fd0976926d727adbdee, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-31 05:53:12,995 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 238598c14b534e639d5fa5b67ebe05f9_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-31 05:53:12,997 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:53:12,998 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:12,999 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a96423b079ea462b8d83d187b673fdae to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a96423b079ea462b8d83d187b673fdae 2023-10-31 05:53:13,001 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103881aaf0272094118bcb84475781ef5ed to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103881aaf0272094118bcb84475781ef5ed 2023-10-31 05:53:13,001 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-31 05:53:13,001 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-31 05:53:13,001 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:53:13,001 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:53:13,024 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): 72f3bdf4e34390e87c32328650f148d0#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:53:13,853 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/6f8430ce78a94a65a133e12856d0dd0b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6f8430ce78a94a65a133e12856d0dd0b 2023-10-31 05:53:13,855 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ac289c3078d0441f80b880fde7e1cc82 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ac289c3078d0441f80b880fde7e1cc82 2023-10-31 05:53:13,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:53:13,861 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 72f3bdf4e34390e87c32328650f148d0/family1 of 72f3bdf4e34390e87c32328650f148d0 into 6f8430ce78a94a65a133e12856d0dd0b(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:53:13,861 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:13,861 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698731592994; duration=0sec 2023-10-31 05:53:13,861 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:13,880 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f90047d6b06a4da2a80377827c256eb3 first=Optional[r1] last=Optional[r4] 2023-10-31 05:53:13,881 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f90047d6b06a4da2a80377827c256eb3}] 2023-10-31 05:53:13,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f90047d6b06a4da2a80377827c256eb3 for inclusion in 72f3bdf4e34390e87c32328650f148d0/family1 2023-10-31 05:53:13,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-31 05:53:13,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:13,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:13,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f90047d6b06a4da2a80377827c256eb3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__i5qorb5dnegd4ngt8tvu8lejlqgqp2hakf7sdkq5hbvtsqbhf56576823g50itn4/family1/f90047d6b06a4da2a80377827c256eb3 2023-10-31 05:53:13,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__i5qorb5dnegd4ngt8tvu8lejlqgqp2hakf7sdkq5hbvtsqbhf56576823g50itn4/family1/f90047d6b06a4da2a80377827c256eb3 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/bea358ac49a841528bb3fb32c5308a40_SeqId_47_ 2023-10-31 05:53:13,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__i5qorb5dnegd4ngt8tvu8lejlqgqp2hakf7sdkq5hbvtsqbhf56576823g50itn4/family1/f90047d6b06a4da2a80377827c256eb3 into 72f3bdf4e34390e87c32328650f148d0/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/bea358ac49a841528bb3fb32c5308a40_SeqId_47_ - updating store file list. 2023-10-31 05:53:13,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/bea358ac49a841528bb3fb32c5308a40_SeqId_47_ into 72f3bdf4e34390e87c32328650f148d0/family1 2023-10-31 05:53:13,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__i5qorb5dnegd4ngt8tvu8lejlqgqp2hakf7sdkq5hbvtsqbhf56576823g50itn4/family1/f90047d6b06a4da2a80377827c256eb3 into 72f3bdf4e34390e87c32328650f148d0/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/bea358ac49a841528bb3fb32c5308a40_SeqId_47_) 2023-10-31 05:53:13,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__i5qorb5dnegd4ngt8tvu8lejlqgqp2hakf7sdkq5hbvtsqbhf56576823g50itn4/family1/f90047d6b06a4da2a80377827c256eb3 2023-10-31 05:53:13,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-31 05:53:13,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/087223eda5b143f8a40c70e904738cc0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/df05b12cf42d46759c6a385f656c3603, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7507b183536f4ad2b66c7c091e83bf33, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6419b2fd54604939b7bd7d50adcd0c31, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/ceab61f8f3e742bb95b3bf1d096b416c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/5b5194830df54a47bd181792340ccc44, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/c902c4ddf2ec4d39afd8b4145bc72fec, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7f7374ee24584225b0d8dfb0c3e1cd74, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/4fde28992dda4fd0976926d727adbdee, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/238598c14b534e639d5fa5b67ebe05f9_SeqId_44_] to archive 2023-10-31 05:53:13,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-31 05:53:13,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): 72f3bdf4e34390e87c32328650f148d0/family1 is initiating minor compaction (all files) 2023-10-31 05:53:13,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@65d7afd0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:13,904 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 72f3bdf4e34390e87c32328650f148d0/family1 in testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:53:13,905 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/634a4f961a664543aaa8198a23b3906b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6f8430ce78a94a65a133e12856d0dd0b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/bea358ac49a841528bb3fb32c5308a40_SeqId_47_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp, totalSize=178.1 K 2023-10-31 05:53:13,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:13,905 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 634a4f961a664543aaa8198a23b3906b, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878848969 2023-10-31 05:53:13,906 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 6f8430ce78a94a65a133e12856d0dd0b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621248969 2023-10-31 05:53:13,906 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting bea358ac49a841528bb3fb32c5308a40_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965248969 2023-10-31 05:53:13,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/087223eda5b143f8a40c70e904738cc0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/087223eda5b143f8a40c70e904738cc0 2023-10-31 05:53:13,906 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:53:13,907 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:13,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/df05b12cf42d46759c6a385f656c3603 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/df05b12cf42d46759c6a385f656c3603 2023-10-31 05:53:13,909 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512019c27b73c89fc4c6584fb0295374fd670 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512019c27b73c89fc4c6584fb0295374fd670 2023-10-31 05:53:13,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7507b183536f4ad2b66c7c091e83bf33 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7507b183536f4ad2b66c7c091e83bf33 2023-10-31 05:53:13,910 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205266186be338e4dba96cc468e8c8c6b6f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205266186be338e4dba96cc468e8c8c6b6f 2023-10-31 05:53:13,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6419b2fd54604939b7bd7d50adcd0c31 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6419b2fd54604939b7bd7d50adcd0c31 2023-10-31 05:53:13,911 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512281c524e3a4fe44c1c90a8c69dc88c8e24 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512281c524e3a4fe44c1c90a8c69dc88c8e24 2023-10-31 05:53:13,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/ceab61f8f3e742bb95b3bf1d096b416c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/ceab61f8f3e742bb95b3bf1d096b416c 2023-10-31 05:53:13,913 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123131727e923a0f47f2883f2d8c5f9fa38e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123131727e923a0f47f2883f2d8c5f9fa38e 2023-10-31 05:53:13,913 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-31 05:53:13,914 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-31 05:53:13,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/5b5194830df54a47bd181792340ccc44 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/5b5194830df54a47bd181792340ccc44 2023-10-31 05:53:13,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:53:13,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:53:13,916 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/c902c4ddf2ec4d39afd8b4145bc72fec to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/c902c4ddf2ec4d39afd8b4145bc72fec 2023-10-31 05:53:13,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7f7374ee24584225b0d8dfb0c3e1cd74 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/7f7374ee24584225b0d8dfb0c3e1cd74 2023-10-31 05:53:13,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/4fde28992dda4fd0976926d727adbdee to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/4fde28992dda4fd0976926d727adbdee 2023-10-31 05:53:13,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/238598c14b534e639d5fa5b67ebe05f9_SeqId_44_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/238598c14b534e639d5fa5b67ebe05f9_SeqId_44_ 2023-10-31 05:53:13,930 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): 72f3bdf4e34390e87c32328650f148d0#family1#compaction#23 average throughput is 12.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:53:14,776 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130697d2ac5eb884412959ff5a743cda286 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130697d2ac5eb884412959ff5a743cda286 2023-10-31 05:53:14,778 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:53:14,804 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a0ca644d8834919a53c4613900b2f28 first=Optional[r00] last=Optional[r8] 2023-10-31 05:53:14,804 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a0ca644d8834919a53c4613900b2f28}] 2023-10-31 05:53:14,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a0ca644d8834919a53c4613900b2f28 for inclusion in 72f3bdf4e34390e87c32328650f148d0/family1 2023-10-31 05:53:14,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-31 05:53:14,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:14,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:14,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a0ca644d8834919a53c4613900b2f28 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1p0db3b7p9u9lq26q34hie4vqts59euf3mscirn4q7h8vrf985jdgqmubvulntq1/family1/7a0ca644d8834919a53c4613900b2f28 2023-10-31 05:53:14,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1p0db3b7p9u9lq26q34hie4vqts59euf3mscirn4q7h8vrf985jdgqmubvulntq1/family1/7a0ca644d8834919a53c4613900b2f28 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/0252c1070e1d440fa6d03eb9ed7e141d_SeqId_49_ 2023-10-31 05:53:14,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1p0db3b7p9u9lq26q34hie4vqts59euf3mscirn4q7h8vrf985jdgqmubvulntq1/family1/7a0ca644d8834919a53c4613900b2f28 into 72f3bdf4e34390e87c32328650f148d0/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/0252c1070e1d440fa6d03eb9ed7e141d_SeqId_49_ - updating store file list. 2023-10-31 05:53:14,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/0252c1070e1d440fa6d03eb9ed7e141d_SeqId_49_ into 72f3bdf4e34390e87c32328650f148d0/family1 2023-10-31 05:53:14,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1p0db3b7p9u9lq26q34hie4vqts59euf3mscirn4q7h8vrf985jdgqmubvulntq1/family1/7a0ca644d8834919a53c4613900b2f28 into 72f3bdf4e34390e87c32328650f148d0/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/0252c1070e1d440fa6d03eb9ed7e141d_SeqId_49_) 2023-10-31 05:53:14,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1p0db3b7p9u9lq26q34hie4vqts59euf3mscirn4q7h8vrf985jdgqmubvulntq1/family1/7a0ca644d8834919a53c4613900b2f28 2023-10-31 05:53:14,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:53:14,826 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:14,828 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120d5f7acff71a6473e89b41e24f8b7e73d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120d5f7acff71a6473e89b41e24f8b7e73d 2023-10-31 05:53:14,830 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511285745e8c8ae1f49a48a13b7ee3f42661d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511285745e8c8ae1f49a48a13b7ee3f42661d 2023-10-31 05:53:14,831 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113043c9a353197846b0b9fa2ef1e7bd54f8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113043c9a353197846b0b9fa2ef1e7bd54f8 2023-10-31 05:53:14,831 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-31 05:53:14,831 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-31 05:53:14,832 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:53:14,832 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:53:14,832 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:53:14,832 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:53:14,832 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:14,833 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:53:14,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7600 sec 2023-10-31 05:53:14,944 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=254 (was 253) Potentially hanging thread: hconnection-0x47105313-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2052209940_17 at /127.0.0.1:55808 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:35968 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/cluster_8ab50123-55f1-194a-5eb5-80cabe53771a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:55754 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64652@0x7b83933f sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1423847649.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:55732 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47105313-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:36040 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47105313-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:35998 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64652@0x7b83933f-SendThread(127.0.0.1:64652) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:55752 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/cluster_8ab50123-55f1-194a-5eb5-80cabe53771a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:55798 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47105313-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64652@0x7b83933f-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:55686 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:55712 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47105313-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47105313-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47105313-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:36024 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/640deb611daa40f18e964f229ed1e5fd java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:35934 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:36012 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10393484_17 at /127.0.0.1:55680 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=604 (was 607), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=289 (was 354), ProcessCount=169 (was 169), AvailableMemoryMB=1901 (was 2189) 2023-10-31 05:53:14,958 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=254, OpenFileDescriptor=604, MaxFileDescriptor=60000, SystemLoadAverage=289, ProcessCount=169, AvailableMemoryMB=1901 2023-10-31 05:53:14,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-31 05:53:14,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:14,963 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:53:14,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-10-31 05:53:14,965 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:53:14,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-31 05:53:14,966 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29 2023-10-31 05:53:14,967 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29 empty. 2023-10-31 05:53:14,967 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29 2023-10-31 05:53:14,968 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-10-31 05:53:15,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-31 05:53:15,165 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/.tmp/family1/640deb611daa40f18e964f229ed1e5fd as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/640deb611daa40f18e964f229ed1e5fd 2023-10-31 05:53:15,173 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 72f3bdf4e34390e87c32328650f148d0/family1 of 72f3bdf4e34390e87c32328650f148d0 into 640deb611daa40f18e964f229ed1e5fd(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:53:15,173 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:53:15,173 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698731593904; duration=1sec 2023-10-31 05:53:15,173 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:15,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/634a4f961a664543aaa8198a23b3906b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6f8430ce78a94a65a133e12856d0dd0b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/bea358ac49a841528bb3fb32c5308a40_SeqId_47_] to archive 2023-10-31 05:53:15,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:15,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/634a4f961a664543aaa8198a23b3906b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/634a4f961a664543aaa8198a23b3906b 2023-10-31 05:53:15,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6f8430ce78a94a65a133e12856d0dd0b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/6f8430ce78a94a65a133e12856d0dd0b 2023-10-31 05:53:15,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/bea358ac49a841528bb3fb32c5308a40_SeqId_47_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/family1/bea358ac49a841528bb3fb32c5308a40_SeqId_47_ 2023-10-31 05:53:15,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-31 05:53:15,377 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-31 05:53:15,378 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 628a5257bb9f5cc770f368f79a62df29, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:53:15,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-31 05:53:15,786 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:15,786 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 628a5257bb9f5cc770f368f79a62df29, disabling compactions & flushes 2023-10-31 05:53:15,786 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:15,786 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:15,786 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. after waiting 0 ms 2023-10-31 05:53:15,786 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:15,786 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:15,787 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:15,789 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:53:15,790 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698731595790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731595790"}]},"ts":"1698731595790"} 2023-10-31 05:53:15,792 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-31 05:53:15,792 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:53:15,793 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731595792"}]},"ts":"1698731595792"} 2023-10-31 05:53:15,794 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-31 05:53:15,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=628a5257bb9f5cc770f368f79a62df29, ASSIGN}] 2023-10-31 05:53:15,799 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=628a5257bb9f5cc770f368f79a62df29, ASSIGN 2023-10-31 05:53:15,800 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=628a5257bb9f5cc770f368f79a62df29, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:53:15,952 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=628a5257bb9f5cc770f368f79a62df29, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:15,952 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698731595952"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731595952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731595952"}]},"ts":"1698731595952"} 2023-10-31 05:53:15,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 628a5257bb9f5cc770f368f79a62df29, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:16,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-31 05:53:16,110 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:16,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:16,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 628a5257bb9f5cc770f368f79a62df29, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:53:16,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 628a5257bb9f5cc770f368f79a62df29 2023-10-31 05:53:16,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:16,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 628a5257bb9f5cc770f368f79a62df29 2023-10-31 05:53:16,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 628a5257bb9f5cc770f368f79a62df29 2023-10-31 05:53:16,119 INFO [StoreOpener-628a5257bb9f5cc770f368f79a62df29-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 628a5257bb9f5cc770f368f79a62df29 2023-10-31 05:53:16,121 DEBUG [StoreOpener-628a5257bb9f5cc770f368f79a62df29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1 2023-10-31 05:53:16,121 DEBUG [StoreOpener-628a5257bb9f5cc770f368f79a62df29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1 2023-10-31 05:53:16,121 INFO [StoreOpener-628a5257bb9f5cc770f368f79a62df29-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 628a5257bb9f5cc770f368f79a62df29 columnFamilyName family1 2023-10-31 05:53:16,123 INFO [StoreOpener-628a5257bb9f5cc770f368f79a62df29-1] regionserver.HStore(310): Store=628a5257bb9f5cc770f368f79a62df29/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:16,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29 2023-10-31 05:53:16,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29 2023-10-31 05:53:16,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 628a5257bb9f5cc770f368f79a62df29 2023-10-31 05:53:16,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:53:16,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 628a5257bb9f5cc770f368f79a62df29; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63379755, jitterRate=-0.05556805431842804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:53:16,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:16,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29., pid=25, masterSystemTime=1698731596110 2023-10-31 05:53:16,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:16,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:16,134 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=628a5257bb9f5cc770f368f79a62df29, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:16,134 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698731596134"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731596134"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731596134"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731596134"}]},"ts":"1698731596134"} 2023-10-31 05:53:16,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-10-31 05:53:16,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 628a5257bb9f5cc770f368f79a62df29, server=jenkins-hbase20.apache.org,43723,1698731565849 in 179 msec 2023-10-31 05:53:16,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-31 05:53:16,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=628a5257bb9f5cc770f368f79a62df29, ASSIGN in 341 msec 2023-10-31 05:53:16,141 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:53:16,141 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731596141"}]},"ts":"1698731596141"} 2023-10-31 05:53:16,142 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-31 05:53:16,144 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:53:16,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1840 sec 2023-10-31 05:53:17,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-31 05:53:17,075 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-10-31 05:53:17,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:17,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,112 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:17,112 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:17,112 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:17,112 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:17,112 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,112 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,113 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:17,113 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:17,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:17,114 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,114 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:17,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:17,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,114 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,115 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:17,115 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:17,115 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:17,115 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:17,115 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:17,115 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:17,115 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. started... 2023-10-31 05:53:17,116 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 628a5257bb9f5cc770f368f79a62df29 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-31 05:53:17,540 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c95a2faec9354121ac23fef8e3f6bea8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130c95a2faec9354121ac23fef8e3f6bea8 2023-10-31 05:53:17,570 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:17,946 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/c15ac3545f8444ef97c78ecbfa04e95f 2023-10-31 05:53:17,955 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/c15ac3545f8444ef97c78ecbfa04e95f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/c15ac3545f8444ef97c78ecbfa04e95f 2023-10-31 05:53:17,961 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/c15ac3545f8444ef97c78ecbfa04e95f, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-31 05:53:17,962 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 628a5257bb9f5cc770f368f79a62df29 in 846ms, sequenceid=5, compaction requested=false 2023-10-31 05:53:17,962 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:17,962 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:17,962 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:17,963 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:17,963 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,963 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:17,963 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:17,964 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,964 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:17,964 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,964 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:17,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:17,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f7e0b3b[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:17,966 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:17,966 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,967 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,967 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:17,967 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:17,967 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:17,967 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:17,968 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,968 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:17,968 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:17,968 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:17,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:17,970 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:17,970 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:17,970 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:17,970 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,970 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:17,971 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,971 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:17,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,971 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:17,972 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,973 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,974 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,974 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,974 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:17,974 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:17,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:17,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:17,974 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:17,974 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:17,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:17,974 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:17,975 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:17,975 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,975 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:17,975 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:17,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:17,975 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,075 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:18,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:18,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:18,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:18,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,083 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:18,083 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:18,083 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:18,083 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:18,084 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,084 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,085 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:18,085 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:18,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:18,085 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,085 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:18,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,086 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,086 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:18,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,087 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:18,087 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:18,087 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:18,087 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:18,087 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:18,087 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:18,087 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. started... 2023-10-31 05:53:18,087 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 628a5257bb9f5cc770f368f79a62df29 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-31 05:53:18,510 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128968cde2e0cb84d649a9ea04f67f3038e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128968cde2e0cb84d649a9ea04f67f3038e 2023-10-31 05:53:18,920 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/9a9ea3bea67642a79558af8ab5b052d3 2023-10-31 05:53:18,932 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/9a9ea3bea67642a79558af8ab5b052d3 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/9a9ea3bea67642a79558af8ab5b052d3 2023-10-31 05:53:18,940 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/9a9ea3bea67642a79558af8ab5b052d3, entries=1, sequenceid=9, filesize=5.0 K 2023-10-31 05:53:18,942 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 628a5257bb9f5cc770f368f79a62df29 in 855ms, sequenceid=9, compaction requested=false 2023-10-31 05:53:18,942 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:18,942 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:18,942 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:18,943 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:18,943 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,943 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:18,943 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:18,944 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,945 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:18,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:18,945 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,945 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:18,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:18,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:18,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ed58d11[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:18,948 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:18,948 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,949 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,949 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:18,949 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:18,949 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:18,949 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,950 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:18,951 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:18,951 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,951 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:18,951 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:18,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:18,955 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:18,955 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:18,955 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:18,955 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,955 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:18,958 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,958 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,959 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:18,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:18,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:18,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:18,959 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,961 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,967 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:18,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:18,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:18,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:18,967 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:18,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:19,067 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:19,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:19,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:19,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:19,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,082 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:19,082 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:19,082 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:19,082 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:19,083 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,083 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,084 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:19,084 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:19,085 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,085 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,087 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,087 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:19,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,088 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:19,088 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:19,088 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:19,088 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:19,088 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:19,088 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:19,088 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. started... 2023-10-31 05:53:19,088 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 628a5257bb9f5cc770f368f79a62df29 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:19,514 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c4232a274ee645d38eb5842510afb62d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201c4232a274ee645d38eb5842510afb62d 2023-10-31 05:53:19,521 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/7f467de87a514650acb0ac87252f1211 2023-10-31 05:53:19,528 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/7f467de87a514650acb0ac87252f1211 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7f467de87a514650acb0ac87252f1211 2023-10-31 05:53:19,534 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7f467de87a514650acb0ac87252f1211, entries=1, sequenceid=13, filesize=4.9 K 2023-10-31 05:53:19,535 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 628a5257bb9f5cc770f368f79a62df29 in 447ms, sequenceid=13, compaction requested=true 2023-10-31 05:53:19,536 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:19,536 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:19,536 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:19,536 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:19,536 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,536 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:19,536 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:19,537 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,537 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:19,538 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,538 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:19,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:19,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:19,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b6b205[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:19,541 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:19,541 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,542 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,542 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:19,542 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:19,542 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:19,542 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,542 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:19,543 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:19,543 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:19,544 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:19,543 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:19,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:19,548 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:19,548 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:19,548 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:19,548 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,548 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:19,549 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:19,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:19,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:19,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:19,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:19,551 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:19,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,552 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:19,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,556 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,556 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,556 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:19,556 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:19,556 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:19,556 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:19,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:19,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:19,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:19,557 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,557 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,557 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:19,557 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,557 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:19,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:19,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:19,557 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,658 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:19,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:19,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:19,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:19,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,673 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:19,673 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:19,673 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:19,673 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:19,674 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,674 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,675 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:19,675 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:19,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:19,676 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:19,676 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:19,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:19,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,676 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,676 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:19,677 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:19,677 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:19,677 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:19,677 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:19,677 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:19,677 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:19,677 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:19,677 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. started... 2023-10-31 05:53:19,677 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 628a5257bb9f5cc770f368f79a62df29 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:20,097 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057654ece445674614ac344b4496a1bfa8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512057654ece445674614ac344b4496a1bfa8 2023-10-31 05:53:20,505 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/3045ef9dd6a34795935a67f6ee07315f 2023-10-31 05:53:20,519 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/3045ef9dd6a34795935a67f6ee07315f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/3045ef9dd6a34795935a67f6ee07315f 2023-10-31 05:53:20,526 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/3045ef9dd6a34795935a67f6ee07315f, entries=1, sequenceid=17, filesize=4.9 K 2023-10-31 05:53:20,527 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 628a5257bb9f5cc770f368f79a62df29 in 850ms, sequenceid=17, compaction requested=true 2023-10-31 05:53:20,527 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:20,527 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:20,527 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:20,527 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:20,527 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,527 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:20,527 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:20,529 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,529 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:20,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:20,529 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,529 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:20,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:20,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:20,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:20,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:20,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67d12319[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:20,532 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:20,532 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,533 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,533 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:20,533 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:20,533 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:20,533 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,533 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:20,534 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:20,534 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:20,534 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:20,534 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:20,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:20,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:20,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:20,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:20,539 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:20,539 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:20,539 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:20,539 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,539 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:20,542 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,542 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,542 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:20,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:20,543 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,545 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:20,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,550 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:20,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:20,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:20,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:20,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:20,551 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:20,551 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:20,551 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,551 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:20,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:20,551 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,552 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,651 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:20,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:20,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:20,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:20,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,667 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:20,667 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:20,667 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:20,667 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:20,668 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,668 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,670 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:20,670 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:20,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:20,670 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:20,670 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:20,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,672 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,673 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:20,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:20,673 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:20,673 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:20,673 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:20,673 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:20,673 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:20,673 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:20,673 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. started... 2023-10-31 05:53:20,674 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 628a5257bb9f5cc770f368f79a62df29 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:21,093 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122881ec2c3b1eaa4cf29b0fc5ade47dc7a3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122881ec2c3b1eaa4cf29b0fc5ade47dc7a3 2023-10-31 05:53:21,501 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/d98338cb6b8446b5863a6417efb9c5be 2023-10-31 05:53:21,507 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/d98338cb6b8446b5863a6417efb9c5be as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/d98338cb6b8446b5863a6417efb9c5be 2023-10-31 05:53:21,513 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/d98338cb6b8446b5863a6417efb9c5be, entries=1, sequenceid=21, filesize=4.9 K 2023-10-31 05:53:21,514 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 628a5257bb9f5cc770f368f79a62df29 in 840ms, sequenceid=21, compaction requested=true 2023-10-31 05:53:21,514 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:21,514 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:21,514 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:21,514 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:21,514 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,514 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:21,515 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:21,515 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,515 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:21,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:21,516 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,516 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:21,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:21,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:21,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:21,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:21,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@819cb0b[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:21,517 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:21,517 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,518 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,518 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:21,518 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:21,518 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:21,518 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,518 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:21,519 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:21,519 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:21,519 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:21,519 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:21,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:21,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:21,521 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:21,521 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:21,521 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:21,521 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,521 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:21,522 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,522 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,522 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:21,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:21,522 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:21,523 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:21,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,525 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,525 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:21,525 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,525 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:21,525 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:21,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:21,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:21,525 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:21,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:21,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:21,525 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,525 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:21,526 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,526 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:21,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:21,526 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:21,526 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,626 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:21,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:21,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:21,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:21,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,633 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:21,633 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:21,633 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:21,633 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:21,634 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,634 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,635 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:21,635 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:21,635 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:21,635 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:21,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,636 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,636 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:21,636 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:21,636 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:21,636 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:21,636 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:21,636 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:21,636 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:21,636 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:21,636 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. started... 2023-10-31 05:53:21,636 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 628a5257bb9f5cc770f368f79a62df29 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:21,648 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:53:22,059 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123172d6dbdc065049b8ac7b1097b55f2bf4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123172d6dbdc065049b8ac7b1097b55f2bf4 2023-10-31 05:53:22,467 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/38d348dbc9ec49bcb0bb01be02b98cb0 2023-10-31 05:53:22,482 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/38d348dbc9ec49bcb0bb01be02b98cb0 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/38d348dbc9ec49bcb0bb01be02b98cb0 2023-10-31 05:53:22,490 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/38d348dbc9ec49bcb0bb01be02b98cb0, entries=1, sequenceid=25, filesize=4.9 K 2023-10-31 05:53:22,492 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 628a5257bb9f5cc770f368f79a62df29 in 856ms, sequenceid=25, compaction requested=true 2023-10-31 05:53:22,492 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:22,492 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:22,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:22,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:22,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:22,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:22,494 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,494 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:22,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:22,494 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:22,494 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:22,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:22,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:22,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:22,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a46721c[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:22,496 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:22,496 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,497 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,497 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:22,497 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,497 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:22,497 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:22,497 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:22,500 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:22,500 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,500 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:22,500 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:22,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:22,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:22,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:22,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:22,503 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:22,503 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:22,503 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:22,503 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,503 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:22,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:22,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:22,518 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:22,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:22,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:22,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,518 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:22,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:22,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:22,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,520 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:22,520 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:22,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:22,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:22,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:22,621 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:22,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:22,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:22,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:22,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,630 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:22,630 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:22,630 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:22,630 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:22,631 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,631 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,632 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:22,632 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:22,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:22,633 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:22,633 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:22,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:22,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,634 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,635 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:22,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:22,635 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:22,635 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:22,635 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:22,635 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:22,635 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:22,635 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:22,635 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. started... 2023-10-31 05:53:22,635 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 628a5257bb9f5cc770f368f79a62df29 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:23,061 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101fd6e8a81fd47441a83a5ed62daa518c9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101fd6e8a81fd47441a83a5ed62daa518c9 2023-10-31 05:53:23,470 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/2676aca89cc64a5ca6674e75853e63cc 2023-10-31 05:53:23,483 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/2676aca89cc64a5ca6674e75853e63cc as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/2676aca89cc64a5ca6674e75853e63cc 2023-10-31 05:53:23,491 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/2676aca89cc64a5ca6674e75853e63cc, entries=1, sequenceid=29, filesize=4.9 K 2023-10-31 05:53:23,492 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 628a5257bb9f5cc770f368f79a62df29 in 857ms, sequenceid=29, compaction requested=true 2023-10-31 05:53:23,492 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:23,492 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:23,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:23,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:23,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:23,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:23,494 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,494 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:23,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:23,495 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,495 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:23,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:23,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:23,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bd1d3cb[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:23,497 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:23,497 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,498 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,499 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:23,499 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:23,499 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:23,499 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,499 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:23,500 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:23,500 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:23,500 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:23,500 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:23,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:23,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:23,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:23,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:23,505 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:23,505 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:23,505 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:23,505 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,505 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:23,506 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,507 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:23,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,507 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:23,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:23,507 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:23,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:23,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,509 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:23,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:23,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,517 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:23,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:23,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:23,517 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:23,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:23,618 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:23,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:23,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:23,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:23,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,633 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:23,633 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:23,633 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:23,633 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:23,634 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,634 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,636 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:23,636 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:23,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:23,636 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:23,637 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:23,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:23,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,638 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,638 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:23,639 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:23,639 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:23,639 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:23,639 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:23,639 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:23,639 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:23,639 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:23,639 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. started... 2023-10-31 05:53:23,640 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 628a5257bb9f5cc770f368f79a62df29 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:24,068 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103dfc38b075ac74a2db68ff050ba1b9b31 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103dfc38b075ac74a2db68ff050ba1b9b31 2023-10-31 05:53:24,477 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/6c4174ce23fa488db089257bf7416b8b 2023-10-31 05:53:24,492 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/6c4174ce23fa488db089257bf7416b8b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/6c4174ce23fa488db089257bf7416b8b 2023-10-31 05:53:24,498 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/6c4174ce23fa488db089257bf7416b8b, entries=1, sequenceid=33, filesize=4.9 K 2023-10-31 05:53:24,499 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 628a5257bb9f5cc770f368f79a62df29 in 859ms, sequenceid=33, compaction requested=true 2023-10-31 05:53:24,499 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:24,499 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:24,499 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:24,499 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:24,499 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,499 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:24,499 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:24,500 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,500 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:24,501 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,501 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:24,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:24,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:24,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:24,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3576fa43[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:24,503 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:24,503 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,503 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,504 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:24,504 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:24,504 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:24,504 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,504 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:24,504 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:24,504 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,505 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:24,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:24,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:24,505 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:24,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:24,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:24,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:24,508 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:24,508 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:24,508 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:24,508 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,508 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:24,509 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,509 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,509 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:24,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:24,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:24,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:24,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:24,510 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:24,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:24,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,511 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:24,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,513 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,513 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:24,513 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:24,513 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:24,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:24,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:24,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:24,513 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:24,513 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:24,514 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,514 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:24,514 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:24,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:24,514 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,514 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,514 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:24,614 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:24,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:24,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:24,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:24,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,629 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:24,630 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:24,630 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:24,630 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:24,630 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,630 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,632 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:24,632 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:24,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:24,632 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:24,632 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,634 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,634 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:24,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:24,635 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:24,635 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:24,635 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:24,635 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:24,635 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:24,635 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:24,635 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. started... 2023-10-31 05:53:24,635 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 628a5257bb9f5cc770f368f79a62df29 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:25,060 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c1d8c1a3c4b8446eb1cc9d17ab5af332 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907c1d8c1a3c4b8446eb1cc9d17ab5af332 2023-10-31 05:53:25,468 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/dd96f8c159484e45a1e2c378c030826e 2023-10-31 05:53:25,479 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/dd96f8c159484e45a1e2c378c030826e as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/dd96f8c159484e45a1e2c378c030826e 2023-10-31 05:53:25,485 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/dd96f8c159484e45a1e2c378c030826e, entries=1, sequenceid=37, filesize=4.9 K 2023-10-31 05:53:25,486 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 628a5257bb9f5cc770f368f79a62df29 in 851ms, sequenceid=37, compaction requested=true 2023-10-31 05:53:25,486 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:25,486 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:25,486 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:25,488 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,488 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:25,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:25,488 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,488 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:25,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:25,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:25,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:25,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:25,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73f12e75[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:25,490 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:25,490 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,491 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,491 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:25,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:25,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:25,492 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,492 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:25,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:25,492 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:25,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:25,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:25,492 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:25,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:25,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:25,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:25,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:25,494 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:25,494 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:25,494 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:25,494 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,494 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:25,495 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,495 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,495 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:25,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:25,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:25,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:25,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:25,496 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:25,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:25,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,497 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:25,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,498 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,498 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,498 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,498 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,498 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:25,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:25,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:25,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:25,498 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:25,498 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:25,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:25,498 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:25,499 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:25,499 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:25,499 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,499 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:25,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:25,599 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:25,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:25,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:25,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:25,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,608 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:25,608 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:25,608 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:25,608 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:25,609 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,609 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,610 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,610 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:25,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:25,611 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:25,611 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,613 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,613 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:25,613 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:25,613 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:25,613 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:25,613 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:25,614 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:25,614 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:25,614 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:25,614 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. started... 2023-10-31 05:53:25,614 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 628a5257bb9f5cc770f368f79a62df29 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:26,042 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ed448d1cd3534f6b9eb25c7475149094 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120ed448d1cd3534f6b9eb25c7475149094 2023-10-31 05:53:26,448 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/4e75e1f25575495ab1d9b837657b3431 2023-10-31 05:53:26,457 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/4e75e1f25575495ab1d9b837657b3431 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/4e75e1f25575495ab1d9b837657b3431 2023-10-31 05:53:26,466 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/4e75e1f25575495ab1d9b837657b3431, entries=1, sequenceid=41, filesize=4.9 K 2023-10-31 05:53:26,467 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 628a5257bb9f5cc770f368f79a62df29 in 853ms, sequenceid=41, compaction requested=true 2023-10-31 05:53:26,467 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:26,467 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:26,467 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:26,468 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:26,468 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,468 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:26,468 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:26,469 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,469 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:26,470 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,470 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:26,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:26,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2afe7485[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:26,471 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:26,471 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,472 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,472 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:26,472 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:26,472 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,472 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:26,472 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:26,473 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,473 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:26,473 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:26,473 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:26,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:26,475 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:26,475 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:26,475 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:26,475 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,475 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:26,476 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,476 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:26,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,476 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:26,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:26,477 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,478 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,479 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,479 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,479 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,479 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:26,479 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:26,479 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:26,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:26,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-31 05:53:26,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:26,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:26,479 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:26,479 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:26,480 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,480 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,480 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:26,480 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:26,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:26,580 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:26,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:26,584 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-10-31 05:53:26,587 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:53:26,589 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:53:26,591 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:26,591 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732206591 2023-10-31 05:53:26,595 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-31 05:53:26,597 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-31 05:53:26,597 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:26,600 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x5b9a9de4 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:53:26,603 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e57d54f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:53:26,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:27,451 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103eeb882e96d2548a9951f1dbc4382ed66 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103eeb882e96d2548a9951f1dbc4382ed66 2023-10-31 05:53:27,452 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:27,468 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:53:27,469 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:53:27,476 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:53:27,478 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:53:27,488 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0503fb509d0f4eac904f9ab0ad900c24 first=Optional[r3] last=Optional[r6] 2023-10-31 05:53:27,489 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0503fb509d0f4eac904f9ab0ad900c24}] 2023-10-31 05:53:27,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0503fb509d0f4eac904f9ab0ad900c24 for inclusion in 628a5257bb9f5cc770f368f79a62df29/family1 2023-10-31 05:53:27,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-31 05:53:27,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:27,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:27,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0503fb509d0f4eac904f9ab0ad900c24 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithWeeklyPolicy__5m11dd9hc9meuvfm5du84p85rpuriu5i75njknse5pn4dl6agoqr522filenib3o/family1/0503fb509d0f4eac904f9ab0ad900c24 2023-10-31 05:53:27,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithWeeklyPolicy__5m11dd9hc9meuvfm5du84p85rpuriu5i75njknse5pn4dl6agoqr522filenib3o/family1/0503fb509d0f4eac904f9ab0ad900c24 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53fda23ceda7433cb12e161b0a25831d_SeqId_44_ 2023-10-31 05:53:27,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithWeeklyPolicy__5m11dd9hc9meuvfm5du84p85rpuriu5i75njknse5pn4dl6agoqr522filenib3o/family1/0503fb509d0f4eac904f9ab0ad900c24 into 628a5257bb9f5cc770f368f79a62df29/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53fda23ceda7433cb12e161b0a25831d_SeqId_44_ - updating store file list. 2023-10-31 05:53:27,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53fda23ceda7433cb12e161b0a25831d_SeqId_44_ into 628a5257bb9f5cc770f368f79a62df29/family1 2023-10-31 05:53:27,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithWeeklyPolicy__5m11dd9hc9meuvfm5du84p85rpuriu5i75njknse5pn4dl6agoqr522filenib3o/family1/0503fb509d0f4eac904f9ab0ad900c24 into 628a5257bb9f5cc770f368f79a62df29/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53fda23ceda7433cb12e161b0a25831d_SeqId_44_) 2023-10-31 05:53:27,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithWeeklyPolicy__5m11dd9hc9meuvfm5du84p85rpuriu5i75njknse5pn4dl6agoqr522filenib3o/family1/0503fb509d0f4eac904f9ab0ad900c24 2023-10-31 05:53:27,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-31 05:53:27,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-31 05:53:27,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): 628a5257bb9f5cc770f368f79a62df29/family1 is initiating minor compaction 2023-10-31 05:53:27,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@69716595; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:27,516 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 628a5257bb9f5cc770f368f79a62df29/family1 in testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:27,517 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/9a9ea3bea67642a79558af8ab5b052d3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7f467de87a514650acb0ac87252f1211, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/3045ef9dd6a34795935a67f6ee07315f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/d98338cb6b8446b5863a6417efb9c5be, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/38d348dbc9ec49bcb0bb01be02b98cb0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/2676aca89cc64a5ca6674e75853e63cc, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/6c4174ce23fa488db089257bf7416b8b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/dd96f8c159484e45a1e2c378c030826e, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/4e75e1f25575495ab1d9b837657b3431, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53fda23ceda7433cb12e161b0a25831d_SeqId_44_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp, totalSize=50.0 K 2023-10-31 05:53:27,517 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 9a9ea3bea67642a79558af8ab5b052d3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-31 05:53:27,517 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 7f467de87a514650acb0ac87252f1211, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-31 05:53:27,517 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 3045ef9dd6a34795935a67f6ee07315f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-31 05:53:27,517 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting d98338cb6b8446b5863a6417efb9c5be, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-31 05:53:27,517 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 38d348dbc9ec49bcb0bb01be02b98cb0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-31 05:53:27,517 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 2676aca89cc64a5ca6674e75853e63cc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-31 05:53:27,517 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 6c4174ce23fa488db089257bf7416b8b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-31 05:53:27,517 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting dd96f8c159484e45a1e2c378c030826e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-31 05:53:27,518 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 4e75e1f25575495ab1d9b837657b3431, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-31 05:53:27,518 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 53fda23ceda7433cb12e161b0a25831d_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-31 05:53:27,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:27,520 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:27,522 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122881ec2c3b1eaa4cf29b0fc5ade47dc7a3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122881ec2c3b1eaa4cf29b0fc5ade47dc7a3 2023-10-31 05:53:27,523 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123172d6dbdc065049b8ac7b1097b55f2bf4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123172d6dbdc065049b8ac7b1097b55f2bf4 2023-10-31 05:53:27,524 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101fd6e8a81fd47441a83a5ed62daa518c9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101fd6e8a81fd47441a83a5ed62daa518c9 2023-10-31 05:53:27,525 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103dfc38b075ac74a2db68ff050ba1b9b31 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103dfc38b075ac74a2db68ff050ba1b9b31 2023-10-31 05:53:27,525 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-31 05:53:27,525 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-31 05:53:27,525 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:27,525 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:27,525 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:27,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:27,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:27,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:27,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:27,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:27,551 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): 628a5257bb9f5cc770f368f79a62df29#family1#compaction#34 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:53:28,373 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120592f3a32fa01c49c0bcddaa34e9c122d9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120592f3a32fa01c49c0bcddaa34e9c122d9 2023-10-31 05:53:28,374 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/53aa0fc63cd8485eb1661ec975e9b9fb as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53aa0fc63cd8485eb1661ec975e9b9fb 2023-10-31 05:53:28,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:28,380 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 628a5257bb9f5cc770f368f79a62df29/family1 of 628a5257bb9f5cc770f368f79a62df29 into 53aa0fc63cd8485eb1661ec975e9b9fb(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:53:28,380 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:28,380 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698731607516; duration=0sec 2023-10-31 05:53:28,380 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:28,400 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7fe4da54f45d4f9d9f5bd15b37fdff35 first=Optional[r1] last=Optional[r2] 2023-10-31 05:53:28,401 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7fe4da54f45d4f9d9f5bd15b37fdff35}] 2023-10-31 05:53:28,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7fe4da54f45d4f9d9f5bd15b37fdff35 for inclusion in 628a5257bb9f5cc770f368f79a62df29/family1 2023-10-31 05:53:28,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/9a9ea3bea67642a79558af8ab5b052d3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7f467de87a514650acb0ac87252f1211, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/3045ef9dd6a34795935a67f6ee07315f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/d98338cb6b8446b5863a6417efb9c5be, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/38d348dbc9ec49bcb0bb01be02b98cb0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/2676aca89cc64a5ca6674e75853e63cc, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/6c4174ce23fa488db089257bf7416b8b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/dd96f8c159484e45a1e2c378c030826e, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/4e75e1f25575495ab1d9b837657b3431, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53fda23ceda7433cb12e161b0a25831d_SeqId_44_] to archive 2023-10-31 05:53:28,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:28,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-31 05:53:28,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:28,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:28,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7fe4da54f45d4f9d9f5bd15b37fdff35 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rp1somj68i8ikfeb90qg1e1lqaphcub1rrpcmk7bkvb0gua6mgdg3269st7ngd8e/family1/7fe4da54f45d4f9d9f5bd15b37fdff35 2023-10-31 05:53:28,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/9a9ea3bea67642a79558af8ab5b052d3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/9a9ea3bea67642a79558af8ab5b052d3 2023-10-31 05:53:28,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7f467de87a514650acb0ac87252f1211 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7f467de87a514650acb0ac87252f1211 2023-10-31 05:53:28,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rp1somj68i8ikfeb90qg1e1lqaphcub1rrpcmk7bkvb0gua6mgdg3269st7ngd8e/family1/7fe4da54f45d4f9d9f5bd15b37fdff35 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7de0ab5c8c324994ba6f090daa3f2913_SeqId_47_ 2023-10-31 05:53:28,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rp1somj68i8ikfeb90qg1e1lqaphcub1rrpcmk7bkvb0gua6mgdg3269st7ngd8e/family1/7fe4da54f45d4f9d9f5bd15b37fdff35 into 628a5257bb9f5cc770f368f79a62df29/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7de0ab5c8c324994ba6f090daa3f2913_SeqId_47_ - updating store file list. 2023-10-31 05:53:28,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/3045ef9dd6a34795935a67f6ee07315f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/3045ef9dd6a34795935a67f6ee07315f 2023-10-31 05:53:28,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/d98338cb6b8446b5863a6417efb9c5be to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/d98338cb6b8446b5863a6417efb9c5be 2023-10-31 05:53:28,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/38d348dbc9ec49bcb0bb01be02b98cb0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/38d348dbc9ec49bcb0bb01be02b98cb0 2023-10-31 05:53:28,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/2676aca89cc64a5ca6674e75853e63cc to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/2676aca89cc64a5ca6674e75853e63cc 2023-10-31 05:53:28,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7de0ab5c8c324994ba6f090daa3f2913_SeqId_47_ into 628a5257bb9f5cc770f368f79a62df29/family1 2023-10-31 05:53:28,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rp1somj68i8ikfeb90qg1e1lqaphcub1rrpcmk7bkvb0gua6mgdg3269st7ngd8e/family1/7fe4da54f45d4f9d9f5bd15b37fdff35 into 628a5257bb9f5cc770f368f79a62df29/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7de0ab5c8c324994ba6f090daa3f2913_SeqId_47_) 2023-10-31 05:53:28,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rp1somj68i8ikfeb90qg1e1lqaphcub1rrpcmk7bkvb0gua6mgdg3269st7ngd8e/family1/7fe4da54f45d4f9d9f5bd15b37fdff35 2023-10-31 05:53:28,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-31 05:53:28,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/6c4174ce23fa488db089257bf7416b8b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/6c4174ce23fa488db089257bf7416b8b 2023-10-31 05:53:28,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-31 05:53:28,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): 628a5257bb9f5cc770f368f79a62df29/family1 is initiating minor compaction (all files) 2023-10-31 05:53:28,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@11b17996; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:28,432 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 628a5257bb9f5cc770f368f79a62df29/family1 in testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:53:28,432 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/c15ac3545f8444ef97c78ecbfa04e95f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53aa0fc63cd8485eb1661ec975e9b9fb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7de0ab5c8c324994ba6f090daa3f2913_SeqId_47_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp, totalSize=176.8 K 2023-10-31 05:53:28,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/dd96f8c159484e45a1e2c378c030826e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/dd96f8c159484e45a1e2c378c030826e 2023-10-31 05:53:28,433 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting c15ac3545f8444ef97c78ecbfa04e95f, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878848969 2023-10-31 05:53:28,433 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 53aa0fc63cd8485eb1661ec975e9b9fb, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621248969 2023-10-31 05:53:28,434 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 7de0ab5c8c324994ba6f090daa3f2913_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965248969 2023-10-31 05:53:28,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/4e75e1f25575495ab1d9b837657b3431 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/4e75e1f25575495ab1d9b837657b3431 2023-10-31 05:53:28,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:28,435 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:28,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53fda23ceda7433cb12e161b0a25831d_SeqId_44_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53fda23ceda7433cb12e161b0a25831d_SeqId_44_ 2023-10-31 05:53:28,437 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201c4232a274ee645d38eb5842510afb62d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201c4232a274ee645d38eb5842510afb62d 2023-10-31 05:53:28,438 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512057654ece445674614ac344b4496a1bfa8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512057654ece445674614ac344b4496a1bfa8 2023-10-31 05:53:28,438 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-10-31 05:53:28,438 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-31 05:53:28,439 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:28,439 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:28,439 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:28,440 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:53:28,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8550 sec 2023-10-31 05:53:28,457 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): 628a5257bb9f5cc770f368f79a62df29#family1#compaction#35 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:53:28,547 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259 (was 254) - Thread LEAK? -, OpenFileDescriptor=617 (was 604) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=245 (was 289), ProcessCount=169 (was 169), AvailableMemoryMB=1822 (was 1901) 2023-10-31 05:53:28,560 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=259, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=245, ProcessCount=169, AvailableMemoryMB=1822 2023-10-31 05:53:28,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-31 05:53:28,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:28,566 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:53:28,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-10-31 05:53:28,567 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:53:28,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-31 05:53:28,570 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:53:28,570 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:53:28,570 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:53:28,571 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb empty. 2023-10-31 05:53:28,571 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0 empty. 2023-10-31 05:53:28,571 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2 empty. 2023-10-31 05:53:28,572 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:53:28,572 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:53:28,572 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:53:28,572 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-10-31 05:53:28,585 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-10-31 05:53:28,587 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => b6985a2cc2919965fb7596a8d6d5d3b2, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:53:28,587 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 34d5b8c551c956a0733f9187888bd6e0, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:53:28,587 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => cea181bfa49537540d492f4100b9b7eb, NAME => 'testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:53:28,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-31 05:53:28,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-31 05:53:29,000 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:29,000 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:29,001 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 34d5b8c551c956a0733f9187888bd6e0, disabling compactions & flushes 2023-10-31 05:53:29,001 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing cea181bfa49537540d492f4100b9b7eb, disabling compactions & flushes 2023-10-31 05:53:29,001 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:29,001 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:29,001 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:29,002 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing b6985a2cc2919965fb7596a8d6d5d3b2, disabling compactions & flushes 2023-10-31 05:53:29,001 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:29,002 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:29,002 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:29,003 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. after waiting 0 ms 2023-10-31 05:53:29,003 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:29,003 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:29,003 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for b6985a2cc2919965fb7596a8d6d5d3b2: 2023-10-31 05:53:29,002 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:29,002 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. after waiting 0 ms 2023-10-31 05:53:29,003 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. after waiting 0 ms 2023-10-31 05:53:29,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:29,004 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:29,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for cea181bfa49537540d492f4100b9b7eb: 2023-10-31 05:53:29,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:29,004 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:29,005 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 34d5b8c551c956a0733f9187888bd6e0: 2023-10-31 05:53:29,010 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:53:29,012 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698731609011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731609011"}]},"ts":"1698731609011"} 2023-10-31 05:53:29,012 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698731609011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731609011"}]},"ts":"1698731609011"} 2023-10-31 05:53:29,012 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698731609011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731609011"}]},"ts":"1698731609011"} 2023-10-31 05:53:29,016 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-31 05:53:29,017 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:53:29,018 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731609017"}]},"ts":"1698731609017"} 2023-10-31 05:53:29,019 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-10-31 05:53:29,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cea181bfa49537540d492f4100b9b7eb, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=34d5b8c551c956a0733f9187888bd6e0, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b6985a2cc2919965fb7596a8d6d5d3b2, ASSIGN}] 2023-10-31 05:53:29,024 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b6985a2cc2919965fb7596a8d6d5d3b2, ASSIGN 2023-10-31 05:53:29,024 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=34d5b8c551c956a0733f9187888bd6e0, ASSIGN 2023-10-31 05:53:29,024 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cea181bfa49537540d492f4100b9b7eb, ASSIGN 2023-10-31 05:53:29,025 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b6985a2cc2919965fb7596a8d6d5d3b2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:53:29,025 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cea181bfa49537540d492f4100b9b7eb, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:53:29,025 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=34d5b8c551c956a0733f9187888bd6e0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:53:29,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-31 05:53:29,178 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cea181bfa49537540d492f4100b9b7eb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:29,178 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=b6985a2cc2919965fb7596a8d6d5d3b2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:29,178 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698731609178"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731609178"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731609178"}]},"ts":"1698731609178"} 2023-10-31 05:53:29,178 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=34d5b8c551c956a0733f9187888bd6e0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:29,179 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698731609178"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731609178"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731609178"}]},"ts":"1698731609178"} 2023-10-31 05:53:29,179 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698731609178"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731609178"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731609178"}]},"ts":"1698731609178"} 2023-10-31 05:53:29,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure cea181bfa49537540d492f4100b9b7eb, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:29,183 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure b6985a2cc2919965fb7596a8d6d5d3b2, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:29,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 34d5b8c551c956a0733f9187888bd6e0, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:29,305 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/.tmp/family1/5fc4a1d72d4a41629cb276e725e08ecf as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/5fc4a1d72d4a41629cb276e725e08ecf 2023-10-31 05:53:29,313 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 628a5257bb9f5cc770f368f79a62df29/family1 of 628a5257bb9f5cc770f368f79a62df29 into 5fc4a1d72d4a41629cb276e725e08ecf(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:53:29,313 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:53:29,313 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1698731608432; duration=0sec 2023-10-31 05:53:29,314 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:29,336 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:29,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:29,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b6985a2cc2919965fb7596a8d6d5d3b2, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2.', STARTKEY => '2', ENDKEY => ''} 2023-10-31 05:53:29,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:53:29,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:29,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:53:29,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:53:29,346 INFO [StoreOpener-b6985a2cc2919965fb7596a8d6d5d3b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:53:29,349 DEBUG [StoreOpener-b6985a2cc2919965fb7596a8d6d5d3b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1 2023-10-31 05:53:29,349 DEBUG [StoreOpener-b6985a2cc2919965fb7596a8d6d5d3b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1 2023-10-31 05:53:29,350 INFO [StoreOpener-b6985a2cc2919965fb7596a8d6d5d3b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6985a2cc2919965fb7596a8d6d5d3b2 columnFamilyName family1 2023-10-31 05:53:29,353 INFO [StoreOpener-b6985a2cc2919965fb7596a8d6d5d3b2-1] regionserver.HStore(310): Store=b6985a2cc2919965fb7596a8d6d5d3b2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:29,353 INFO [StoreOpener-b6985a2cc2919965fb7596a8d6d5d3b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:53:29,355 DEBUG [StoreOpener-b6985a2cc2919965fb7596a8d6d5d3b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family2 2023-10-31 05:53:29,355 DEBUG [StoreOpener-b6985a2cc2919965fb7596a8d6d5d3b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family2 2023-10-31 05:53:29,355 INFO [StoreOpener-b6985a2cc2919965fb7596a8d6d5d3b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6985a2cc2919965fb7596a8d6d5d3b2 columnFamilyName family2 2023-10-31 05:53:29,357 INFO [StoreOpener-b6985a2cc2919965fb7596a8d6d5d3b2-1] regionserver.HStore(310): Store=b6985a2cc2919965fb7596a8d6d5d3b2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:29,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:53:29,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:53:29,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:53:29,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:53:29,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:53:29,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b6985a2cc2919965fb7596a8d6d5d3b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68369276, jitterRate=0.018781602382659912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:53:29,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b6985a2cc2919965fb7596a8d6d5d3b2: 2023-10-31 05:53:29,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2., pid=32, masterSystemTime=1698731609336 2023-10-31 05:53:29,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:29,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:29,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:29,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34d5b8c551c956a0733f9187888bd6e0, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0.', STARTKEY => '1', ENDKEY => '2'} 2023-10-31 05:53:29,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:53:29,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:29,369 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=b6985a2cc2919965fb7596a8d6d5d3b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:29,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:53:29,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:53:29,369 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698731609369"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731609369"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731609369"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731609369"}]},"ts":"1698731609369"} 2023-10-31 05:53:29,371 INFO [StoreOpener-34d5b8c551c956a0733f9187888bd6e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:53:29,373 DEBUG [StoreOpener-34d5b8c551c956a0733f9187888bd6e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0/family1 2023-10-31 05:53:29,373 DEBUG [StoreOpener-34d5b8c551c956a0733f9187888bd6e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0/family1 2023-10-31 05:53:29,374 INFO [StoreOpener-34d5b8c551c956a0733f9187888bd6e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34d5b8c551c956a0733f9187888bd6e0 columnFamilyName family1 2023-10-31 05:53:29,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=30 2023-10-31 05:53:29,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure b6985a2cc2919965fb7596a8d6d5d3b2, server=jenkins-hbase20.apache.org,43723,1698731565849 in 189 msec 2023-10-31 05:53:29,376 INFO [StoreOpener-34d5b8c551c956a0733f9187888bd6e0-1] regionserver.HStore(310): Store=34d5b8c551c956a0733f9187888bd6e0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:29,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b6985a2cc2919965fb7596a8d6d5d3b2, ASSIGN in 352 msec 2023-10-31 05:53:29,376 INFO [StoreOpener-34d5b8c551c956a0733f9187888bd6e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:53:29,379 DEBUG [StoreOpener-34d5b8c551c956a0733f9187888bd6e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0/family2 2023-10-31 05:53:29,379 DEBUG [StoreOpener-34d5b8c551c956a0733f9187888bd6e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0/family2 2023-10-31 05:53:29,380 INFO [StoreOpener-34d5b8c551c956a0733f9187888bd6e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34d5b8c551c956a0733f9187888bd6e0 columnFamilyName family2 2023-10-31 05:53:29,381 INFO [StoreOpener-34d5b8c551c956a0733f9187888bd6e0-1] regionserver.HStore(310): Store=34d5b8c551c956a0733f9187888bd6e0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:29,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:53:29,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:53:29,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:53:29,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:53:29,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:53:29,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 34d5b8c551c956a0733f9187888bd6e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72724278, jitterRate=0.08367618918418884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:53:29,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 34d5b8c551c956a0733f9187888bd6e0: 2023-10-31 05:53:29,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0., pid=33, masterSystemTime=1698731609336 2023-10-31 05:53:29,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:29,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:29,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:29,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cea181bfa49537540d492f4100b9b7eb, NAME => 'testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb.', STARTKEY => '', ENDKEY => '1'} 2023-10-31 05:53:29,391 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=34d5b8c551c956a0733f9187888bd6e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:29,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:53:29,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:29,391 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698731609391"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731609391"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731609391"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731609391"}]},"ts":"1698731609391"} 2023-10-31 05:53:29,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:53:29,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:53:29,393 INFO [StoreOpener-cea181bfa49537540d492f4100b9b7eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:53:29,394 DEBUG [StoreOpener-cea181bfa49537540d492f4100b9b7eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb/family1 2023-10-31 05:53:29,394 DEBUG [StoreOpener-cea181bfa49537540d492f4100b9b7eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb/family1 2023-10-31 05:53:29,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=29 2023-10-31 05:53:29,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 34d5b8c551c956a0733f9187888bd6e0, server=jenkins-hbase20.apache.org,43723,1698731565849 in 208 msec 2023-10-31 05:53:29,395 INFO [StoreOpener-cea181bfa49537540d492f4100b9b7eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cea181bfa49537540d492f4100b9b7eb columnFamilyName family1 2023-10-31 05:53:29,397 INFO [StoreOpener-cea181bfa49537540d492f4100b9b7eb-1] regionserver.HStore(310): Store=cea181bfa49537540d492f4100b9b7eb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:29,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=34d5b8c551c956a0733f9187888bd6e0, ASSIGN in 373 msec 2023-10-31 05:53:29,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/c15ac3545f8444ef97c78ecbfa04e95f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53aa0fc63cd8485eb1661ec975e9b9fb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7de0ab5c8c324994ba6f090daa3f2913_SeqId_47_] to archive 2023-10-31 05:53:29,399 INFO [StoreOpener-cea181bfa49537540d492f4100b9b7eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:53:29,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:29,400 DEBUG [StoreOpener-cea181bfa49537540d492f4100b9b7eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb/family2 2023-10-31 05:53:29,400 DEBUG [StoreOpener-cea181bfa49537540d492f4100b9b7eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb/family2 2023-10-31 05:53:29,401 INFO [StoreOpener-cea181bfa49537540d492f4100b9b7eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cea181bfa49537540d492f4100b9b7eb columnFamilyName family2 2023-10-31 05:53:29,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/c15ac3545f8444ef97c78ecbfa04e95f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/c15ac3545f8444ef97c78ecbfa04e95f 2023-10-31 05:53:29,402 INFO [StoreOpener-cea181bfa49537540d492f4100b9b7eb-1] regionserver.HStore(310): Store=cea181bfa49537540d492f4100b9b7eb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:29,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53aa0fc63cd8485eb1661ec975e9b9fb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/53aa0fc63cd8485eb1661ec975e9b9fb 2023-10-31 05:53:29,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:53:29,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:53:29,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7de0ab5c8c324994ba6f090daa3f2913_SeqId_47_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/family1/7de0ab5c8c324994ba6f090daa3f2913_SeqId_47_ 2023-10-31 05:53:29,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:53:29,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:53:29,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:53:29,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cea181bfa49537540d492f4100b9b7eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62143330, jitterRate=-0.07399222254753113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:53:29,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cea181bfa49537540d492f4100b9b7eb: 2023-10-31 05:53:29,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb., pid=31, masterSystemTime=1698731609336 2023-10-31 05:53:29,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:29,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:29,410 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cea181bfa49537540d492f4100b9b7eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:29,410 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698731609410"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731609410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731609410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731609410"}]},"ts":"1698731609410"} 2023-10-31 05:53:29,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-31 05:53:29,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure cea181bfa49537540d492f4100b9b7eb, server=jenkins-hbase20.apache.org,43723,1698731565849 in 230 msec 2023-10-31 05:53:29,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-31 05:53:29,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cea181bfa49537540d492f4100b9b7eb, ASSIGN in 392 msec 2023-10-31 05:53:29,416 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:53:29,417 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731609416"}]},"ts":"1698731609416"} 2023-10-31 05:53:29,418 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-10-31 05:53:29,420 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:53:29,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 857 msec 2023-10-31 05:53:29,573 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-10-31 05:53:29,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-31 05:53:29,674 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-10-31 05:53:29,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:29,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:29,691 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-31 05:53:29,691 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:29,692 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-31 05:53:29,692 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-31 05:53:29,692 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:29,692 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:29,694 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:29,694 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:29,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:29,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:29,695 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:29,695 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:29,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:29,696 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:29,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:29,697 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-31 05:53:29,697 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:29,697 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-31 05:53:29,697 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:29,697 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. started... 2023-10-31 05:53:29,697 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:53:29,698 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:29,697 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:29,698 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. started... 2023-10-31 05:53:29,698 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cea181bfa49537540d492f4100b9b7eb: 2023-10-31 05:53:29,699 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:29,698 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:29,699 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. started... 2023-10-31 05:53:29,699 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:53:29,699 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b6985a2cc2919965fb7596a8d6d5d3b2 2/2 column families, dataSize=48 B heapSize=632 B 2023-10-31 05:53:29,699 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 34d5b8c551c956a0733f9187888bd6e0: 2023-10-31 05:53:29,699 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:29,699 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:53:30,122 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031c06b54b696d84ee9a19bace0f499ac6c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231031c06b54b696d84ee9a19bace0f499ac6c 2023-10-31 05:53:30,529 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/.tmp/family1/1f264e2731684505a9af01171ba1896a 2023-10-31 05:53:30,541 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/.tmp/family1/1f264e2731684505a9af01171ba1896a as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/1f264e2731684505a9af01171ba1896a 2023-10-31 05:53:30,547 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/1f264e2731684505a9af01171ba1896a, entries=1, sequenceid=5, filesize=4.9 K 2023-10-31 05:53:30,548 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for b6985a2cc2919965fb7596a8d6d5d3b2 in 849ms, sequenceid=5, compaction requested=false 2023-10-31 05:53:30,549 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b6985a2cc2919965fb7596a8d6d5d3b2: 2023-10-31 05:53:30,549 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:30,549 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:53:30,549 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:53:30,549 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,549 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-31 05:53:30,549 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-31 05:53:30,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,550 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:30,551 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,551 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:30,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:30,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:30,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:30,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-31 05:53:30,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f64b59a[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:30,552 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-31 05:53:30,553 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,553 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,553 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-31 05:53:30,553 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-31 05:53:30,553 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,553 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:30,553 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:30,555 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,555 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-31 05:53:30,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,555 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:30,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:30,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:30,555 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-31 05:53:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:30,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:30,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-31 05:53:30,559 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-31 05:53:30,559 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:30,559 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:30,559 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,559 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:30,560 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,560 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:30,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,560 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:30,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:30,561 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:30,562 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:30,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:30,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-31 05:53:30,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:30,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-31 05:53:30,564 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:30,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:30,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:30,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,565 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:30,565 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:30,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:30,665 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:30,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:30,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:30,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:30,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,677 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-31 05:53:30,677 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:30,677 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-31 05:53:30,677 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-31 05:53:30,678 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,678 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,680 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:30,680 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:30,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:30,681 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:30,681 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:30,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:30,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,683 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,683 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-10-31 05:53:30,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:30,684 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-31 05:53:30,684 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:30,684 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-31 05:53:30,684 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:30,684 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:30,684 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. started... 2023-10-31 05:53:30,684 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:53:30,685 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b6985a2cc2919965fb7596a8d6d5d3b2 2/2 column families, dataSize=90 B heapSize=752 B 2023-10-31 05:53:30,684 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. started... 2023-10-31 05:53:30,685 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:30,684 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:30,685 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. started... 2023-10-31 05:53:30,685 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cea181bfa49537540d492f4100b9b7eb: 2023-10-31 05:53:30,685 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:53:30,685 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 34d5b8c551c956a0733f9187888bd6e0: 2023-10-31 05:53:30,685 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:53:30,685 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:53:30,686 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:53:31,106 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031cc14acfa2d4d4027a875abe77a4cb610 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231031cc14acfa2d4d4027a875abe77a4cb610 2023-10-31 05:53:31,516 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/.tmp/family1/d91eab32ce304d6598463a86bbc3c3da 2023-10-31 05:53:31,529 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/.tmp/family1/d91eab32ce304d6598463a86bbc3c3da as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/d91eab32ce304d6598463a86bbc3c3da 2023-10-31 05:53:31,535 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/d91eab32ce304d6598463a86bbc3c3da, entries=2, sequenceid=9, filesize=5.0 K 2023-10-31 05:53:31,536 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for b6985a2cc2919965fb7596a8d6d5d3b2 in 851ms, sequenceid=9, compaction requested=false 2023-10-31 05:53:31,536 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b6985a2cc2919965fb7596a8d6d5d3b2: 2023-10-31 05:53:31,536 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:31,536 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:53:31,536 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:53:31,536 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,536 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-31 05:53:31,536 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-31 05:53:31,537 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,538 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:31,538 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,538 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:31,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-31 05:53:31,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d42ecd7[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:31,540 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-31 05:53:31,540 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,541 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,541 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-31 05:53:31,541 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-31 05:53:31,541 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:31,541 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,541 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:31,542 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-31 05:53:31,542 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:31,542 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,542 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-31 05:53:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:31,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-31 05:53:31,546 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-31 05:53:31,546 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:31,546 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:31,546 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,546 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:31,555 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,555 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:31,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,555 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:31,556 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,558 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,563 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,563 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:31,563 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:31,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:31,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-31 05:53:31,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-31 05:53:31,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:31,563 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:31,563 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:31,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:31,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:31,564 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:31,564 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:31,564 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:31,565 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,565 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,565 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,665 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:31,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:31,681 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-10-31 05:53:31,683 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-31 05:53:31,684 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-31 05:53:31,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:31,685 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732211685 2023-10-31 05:53:31,686 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:53:31,686 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-10-31 05:53:31,686 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-31 05:53:31,688 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x1dbb774f to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:53:31,693 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3de6341a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:53:31,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231031 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-31 05:53:32,135 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310317741848e965c428ba91c8541412e2ad9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310317741848e965c428ba91c8541412e2ad9 2023-10-31 05:53:32,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231031 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-31 05:53:32,149 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:53:32,150 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:53:32,158 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:53:32,160 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:53:32,170 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231031/family1/3bb2b91fe8384fb1a19e81b4324daeaa first=Optional[k0] last=Optional[k1] 2023-10-31 05:53:32,170 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231031/family1/3bb2b91fe8384fb1a19e81b4324daeaa}] 2023-10-31 05:53:32,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231031/family1/3bb2b91fe8384fb1a19e81b4324daeaa for inclusion in b6985a2cc2919965fb7596a8d6d5d3b2/family1 2023-10-31 05:53:32,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-10-31 05:53:32,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-31 05:53:32,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for b6985a2cc2919965fb7596a8d6d5d3b2: 2023-10-31 05:53:32,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231031/family1/3bb2b91fe8384fb1a19e81b4324daeaa to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testScannerOnBulkLoadRefHFiles__4vh8ml44vfodbs4i15h8lmt7m6jt28kagndnpao9hdrqipuvnt6oh4e8gq0qq6f0/family1/3bb2b91fe8384fb1a19e81b4324daeaa 2023-10-31 05:53:32,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testScannerOnBulkLoadRefHFiles__4vh8ml44vfodbs4i15h8lmt7m6jt28kagndnpao9hdrqipuvnt6oh4e8gq0qq6f0/family1/3bb2b91fe8384fb1a19e81b4324daeaa as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/833a135051504f498287c5849098a99a_SeqId_12_ 2023-10-31 05:53:32,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testScannerOnBulkLoadRefHFiles__4vh8ml44vfodbs4i15h8lmt7m6jt28kagndnpao9hdrqipuvnt6oh4e8gq0qq6f0/family1/3bb2b91fe8384fb1a19e81b4324daeaa into b6985a2cc2919965fb7596a8d6d5d3b2/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/833a135051504f498287c5849098a99a_SeqId_12_ - updating store file list. 2023-10-31 05:53:32,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/833a135051504f498287c5849098a99a_SeqId_12_ into b6985a2cc2919965fb7596a8d6d5d3b2/family1 2023-10-31 05:53:32,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testScannerOnBulkLoadRefHFiles__4vh8ml44vfodbs4i15h8lmt7m6jt28kagndnpao9hdrqipuvnt6oh4e8gq0qq6f0/family1/3bb2b91fe8384fb1a19e81b4324daeaa into b6985a2cc2919965fb7596a8d6d5d3b2/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/833a135051504f498287c5849098a99a_SeqId_12_) 2023-10-31 05:53:32,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testScannerOnBulkLoadRefHFiles__4vh8ml44vfodbs4i15h8lmt7m6jt28kagndnpao9hdrqipuvnt6oh4e8gq0qq6f0/family1/3bb2b91fe8384fb1a19e81b4324daeaa 2023-10-31 05:53:32,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-31 05:53:32,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-31 05:53:32,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): b6985a2cc2919965fb7596a8d6d5d3b2/family1 is initiating minor compaction (all files) 2023-10-31 05:53:32,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@48c67ad8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-31 05:53:32,187 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b6985a2cc2919965fb7596a8d6d5d3b2/family1 in testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:53:32,188 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/1f264e2731684505a9af01171ba1896a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/d91eab32ce304d6598463a86bbc3c3da, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/833a135051504f498287c5849098a99a_SeqId_12_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/.tmp, totalSize=15.1 K 2023-10-31 05:53:32,188 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 1f264e2731684505a9af01171ba1896a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731609675 2023-10-31 05:53:32,189 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting d91eab32ce304d6598463a86bbc3c3da, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731609675 2023-10-31 05:53:32,189 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 833a135051504f498287c5849098a99a_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731609675 2023-10-31 05:53:32,190 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231031 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-31 05:53:32,190 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:32,192 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231031c06b54b696d84ee9a19bace0f499ac6c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231031c06b54b696d84ee9a19bace0f499ac6c 2023-10-31 05:53:32,194 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231031cc14acfa2d4d4027a875abe77a4cb610 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231031cc14acfa2d4d4027a875abe77a4cb610 2023-10-31 05:53:32,194 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-10-31 05:53:32,194 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231031' 2023-10-31 05:53:32,195 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231031 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-31 05:53:32,195 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-31 05:53:32,195 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:32,196 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-31 05:53:32,197 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 514 msec 2023-10-31 05:53:32,201 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): b6985a2cc2919965fb7596a8d6d5d3b2#family1#compaction#38 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:53:32,237 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=264 (was 259) - Thread LEAK? -, OpenFileDescriptor=626 (was 617) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=225 (was 245), ProcessCount=169 (was 169), AvailableMemoryMB=1797 (was 1822) 2023-10-31 05:53:32,250 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=264, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=225, ProcessCount=169, AvailableMemoryMB=1796 2023-10-31 05:53:32,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-31 05:53:32,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:32,255 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:53:32,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-10-31 05:53:32,256 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:53:32,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-31 05:53:32,257 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6 2023-10-31 05:53:32,258 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6 empty. 2023-10-31 05:53:32,259 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6 2023-10-31 05:53:32,259 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-10-31 05:53:32,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-31 05:53:32,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-31 05:53:32,673 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-31 05:53:32,677 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => eaf0660ca2db156b91cead03709332e6, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:53:32,690 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:32,690 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing eaf0660ca2db156b91cead03709332e6, disabling compactions & flushes 2023-10-31 05:53:32,690 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:32,690 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:32,690 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. after waiting 0 ms 2023-10-31 05:53:32,691 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:32,691 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:32,691 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:32,696 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:53:32,697 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698731612697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731612697"}]},"ts":"1698731612697"} 2023-10-31 05:53:32,699 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-31 05:53:32,700 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:53:32,700 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731612700"}]},"ts":"1698731612700"} 2023-10-31 05:53:32,701 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-31 05:53:32,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=eaf0660ca2db156b91cead03709332e6, ASSIGN}] 2023-10-31 05:53:32,706 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=eaf0660ca2db156b91cead03709332e6, ASSIGN 2023-10-31 05:53:32,707 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=eaf0660ca2db156b91cead03709332e6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:53:32,858 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=eaf0660ca2db156b91cead03709332e6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:32,859 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698731612858"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731612858"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731612858"}]},"ts":"1698731612858"} 2023-10-31 05:53:32,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure eaf0660ca2db156b91cead03709332e6, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:32,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-31 05:53:33,015 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:33,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eaf0660ca2db156b91cead03709332e6, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:53:33,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy eaf0660ca2db156b91cead03709332e6 2023-10-31 05:53:33,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:33,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for eaf0660ca2db156b91cead03709332e6 2023-10-31 05:53:33,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for eaf0660ca2db156b91cead03709332e6 2023-10-31 05:53:33,025 INFO [StoreOpener-eaf0660ca2db156b91cead03709332e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region eaf0660ca2db156b91cead03709332e6 2023-10-31 05:53:33,027 DEBUG [StoreOpener-eaf0660ca2db156b91cead03709332e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1 2023-10-31 05:53:33,027 DEBUG [StoreOpener-eaf0660ca2db156b91cead03709332e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1 2023-10-31 05:53:33,027 INFO [StoreOpener-eaf0660ca2db156b91cead03709332e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eaf0660ca2db156b91cead03709332e6 columnFamilyName family1 2023-10-31 05:53:33,029 INFO [StoreOpener-eaf0660ca2db156b91cead03709332e6-1] regionserver.HStore(310): Store=eaf0660ca2db156b91cead03709332e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:33,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6 2023-10-31 05:53:33,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6 2023-10-31 05:53:33,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for eaf0660ca2db156b91cead03709332e6 2023-10-31 05:53:33,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:53:33,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened eaf0660ca2db156b91cead03709332e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73898292, jitterRate=0.1011703610420227}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:53:33,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:33,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6., pid=37, masterSystemTime=1698731613015 2023-10-31 05:53:33,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:33,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:33,040 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=eaf0660ca2db156b91cead03709332e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,040 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698731613040"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731613040"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731613040"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731613040"}]},"ts":"1698731613040"} 2023-10-31 05:53:33,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-31 05:53:33,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure eaf0660ca2db156b91cead03709332e6, server=jenkins-hbase20.apache.org,43723,1698731565849 in 180 msec 2023-10-31 05:53:33,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-10-31 05:53:33,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=eaf0660ca2db156b91cead03709332e6, ASSIGN in 340 msec 2023-10-31 05:53:33,047 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:53:33,047 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731613047"}]},"ts":"1698731613047"} 2023-10-31 05:53:33,049 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-31 05:53:33,051 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:53:33,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 799 msec 2023-10-31 05:53:33,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-31 05:53:33,366 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-10-31 05:53:33,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:33,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,404 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:33,404 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:33,404 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:33,404 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:33,405 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,405 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,406 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:33,406 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:33,406 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,406 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:33,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,407 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,407 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,407 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:33,407 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:33,407 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:33,407 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:33,407 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:33,407 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:33,407 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. started... 2023-10-31 05:53:33,408 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eaf0660ca2db156b91cead03709332e6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-31 05:53:33,431 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/.tmp/family1/bcfe9af9ad7a4845ba29f277e6bab764 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/bcfe9af9ad7a4845ba29f277e6bab764 2023-10-31 05:53:33,436 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b6985a2cc2919965fb7596a8d6d5d3b2/family1 of b6985a2cc2919965fb7596a8d6d5d3b2 into bcfe9af9ad7a4845ba29f277e6bab764(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:53:33,436 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b6985a2cc2919965fb7596a8d6d5d3b2: 2023-10-31 05:53:33,436 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1698731612187; duration=1sec 2023-10-31 05:53:33,436 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:33,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/1f264e2731684505a9af01171ba1896a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/d91eab32ce304d6598463a86bbc3c3da, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/833a135051504f498287c5849098a99a_SeqId_12_] to archive 2023-10-31 05:53:33,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:33,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/1f264e2731684505a9af01171ba1896a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/1f264e2731684505a9af01171ba1896a 2023-10-31 05:53:33,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/d91eab32ce304d6598463a86bbc3c3da to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/d91eab32ce304d6598463a86bbc3c3da 2023-10-31 05:53:33,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/833a135051504f498287c5849098a99a_SeqId_12_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/family1/833a135051504f498287c5849098a99a_SeqId_12_ 2023-10-31 05:53:33,833 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c03665574b45417da1ebb221664c810d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c03665574b45417da1ebb221664c810d 2023-10-31 05:53:33,839 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/08767225bca34d0eb883122fb0a75271 2023-10-31 05:53:33,847 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/08767225bca34d0eb883122fb0a75271 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/08767225bca34d0eb883122fb0a75271 2023-10-31 05:53:33,854 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/08767225bca34d0eb883122fb0a75271, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-31 05:53:33,855 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for eaf0660ca2db156b91cead03709332e6 in 447ms, sequenceid=5, compaction requested=false 2023-10-31 05:53:33,855 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:33,856 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:33,856 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:33,856 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:33,856 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:33,856 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,857 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:33,857 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:33,858 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,858 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:33,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:33,858 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,859 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:33,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:33,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:33,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:33,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:33,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bae78c[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:33,861 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:33,861 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,862 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,862 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:33,862 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:33,862 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:33,862 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,862 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:33,863 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:33,863 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,863 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:33,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:33,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:33,864 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:33,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:33,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:33,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:33,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:33,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:33,867 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:33,867 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:33,868 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:33,868 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,868 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:33,869 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,869 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:33,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:33,869 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:33,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:33,870 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:33,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:33,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:33,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,872 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:33,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,875 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,875 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,875 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:33,875 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,875 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,875 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:33,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:33,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:33,875 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:33,875 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:33,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:33,876 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:33,876 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:33,875 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:33,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:33,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:33,876 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,976 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:33,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:33,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:33,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:33,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,992 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:33,992 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:33,992 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:33,992 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:33,993 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,993 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,994 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,994 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:33,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:33,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:33,994 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:33,994 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:33,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:33,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,995 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,996 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:33,996 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:33,996 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:33,996 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:33,996 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:33,996 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:33,996 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:33,996 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:33,996 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. started... 2023-10-31 05:53:33,996 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eaf0660ca2db156b91cead03709332e6 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-31 05:53:34,412 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128088d2f195bd34f15ae91d89df62842ad to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128088d2f195bd34f15ae91d89df62842ad 2023-10-31 05:53:34,820 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/d4204afb3ab84ae3a8d06aa60b71098f 2023-10-31 05:53:34,832 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/d4204afb3ab84ae3a8d06aa60b71098f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d4204afb3ab84ae3a8d06aa60b71098f 2023-10-31 05:53:34,837 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d4204afb3ab84ae3a8d06aa60b71098f, entries=1, sequenceid=9, filesize=5.0 K 2023-10-31 05:53:34,838 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for eaf0660ca2db156b91cead03709332e6 in 842ms, sequenceid=9, compaction requested=false 2023-10-31 05:53:34,838 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:34,838 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:34,838 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:34,838 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:34,838 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,838 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:34,838 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:34,840 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,840 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:34,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:34,840 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,840 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:34,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:34,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:34,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:34,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:34,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e39e1a2[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:34,842 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:34,843 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,845 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,845 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:34,845 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:34,845 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:34,845 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,845 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:34,847 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:34,847 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:34,847 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,847 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:34,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:34,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:34,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:34,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:34,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:34,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:34,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:34,850 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:34,850 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:34,850 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:34,850 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,850 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:34,852 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,852 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:34,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:34,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,852 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:34,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:34,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:34,853 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:34,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:34,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,854 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:34,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:34,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:34,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:34,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:34,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:34,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,858 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:34,857 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:34,858 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:34,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:34,858 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:34,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:34,885 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:53:34,923 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:53:34,924 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dbb774f to 127.0.0.1:64652 2023-10-31 05:53:34,924 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:53:34,925 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:53:34,925 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b9a9de4 to 127.0.0.1:64652 2023-10-31 05:53:34,925 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:53:34,927 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:53:34,928 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b83933f to 127.0.0.1:64652 2023-10-31 05:53:34,928 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:53:34,928 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:53:34,928 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f8a9a4d to 127.0.0.1:64652 2023-10-31 05:53:34,928 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:53:34,928 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:53:34,928 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x563db2dc to 127.0.0.1:64652 2023-10-31 05:53:34,928 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:53:34,958 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:34,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:34,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:34,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:34,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,966 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:34,966 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:34,966 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:34,966 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:34,966 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,966 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,967 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,967 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:34,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:34,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:34,968 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:34,968 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:34,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:34,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,969 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:34,969 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:34,969 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:34,969 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:34,969 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:34,969 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:34,969 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:34,969 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. started... 2023-10-31 05:53:34,969 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eaf0660ca2db156b91cead03709332e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:35,393 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ee40d2c02cd6422da5fbf27f5faee53d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201ee40d2c02cd6422da5fbf27f5faee53d 2023-10-31 05:53:35,799 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/d9f52c97a4954c029408a4a23dc615c8 2023-10-31 05:53:35,808 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/d9f52c97a4954c029408a4a23dc615c8 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d9f52c97a4954c029408a4a23dc615c8 2023-10-31 05:53:35,815 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d9f52c97a4954c029408a4a23dc615c8, entries=1, sequenceid=13, filesize=4.9 K 2023-10-31 05:53:35,816 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eaf0660ca2db156b91cead03709332e6 in 847ms, sequenceid=13, compaction requested=true 2023-10-31 05:53:35,817 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:35,817 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:35,817 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:35,817 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:35,817 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,817 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:35,817 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:35,819 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,819 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:35,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:35,819 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,819 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:35,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:35,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42b579a[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:35,822 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:35,822 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,823 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,824 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:35,824 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:35,824 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:35,824 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,824 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:35,825 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:35,825 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,825 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:35,825 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:35,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:35,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:35,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:35,829 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:35,830 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:35,830 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:35,830 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,830 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:35,841 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,841 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,841 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:35,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:35,842 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:35,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,843 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:35,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,846 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,846 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:35,846 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,846 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:35,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:35,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:35,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:35,846 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,846 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:35,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:35,847 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,847 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:35,847 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:35,847 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:35,847 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,847 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,947 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:35,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:35,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:35,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:35,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,954 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:35,954 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:35,954 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:35,954 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:35,954 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,954 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,955 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,955 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:35,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:35,955 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:35,955 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,956 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,957 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:35,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:35,957 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:35,957 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:35,957 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:35,957 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:35,957 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:35,957 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:35,957 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. started... 2023-10-31 05:53:35,957 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eaf0660ca2db156b91cead03709332e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:36,378 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120585d4ac82b8ca4effaa182d595a2c4255 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120585d4ac82b8ca4effaa182d595a2c4255 2023-10-31 05:53:36,786 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/91c23daf91364da0b8ec9984e9f7ef53 2023-10-31 05:53:36,799 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/91c23daf91364da0b8ec9984e9f7ef53 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/91c23daf91364da0b8ec9984e9f7ef53 2023-10-31 05:53:36,806 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/91c23daf91364da0b8ec9984e9f7ef53, entries=1, sequenceid=17, filesize=4.9 K 2023-10-31 05:53:36,807 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eaf0660ca2db156b91cead03709332e6 in 850ms, sequenceid=17, compaction requested=true 2023-10-31 05:53:36,807 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:36,807 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:36,807 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:36,807 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:36,807 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,807 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:36,807 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:36,809 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,809 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:36,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:36,810 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,810 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:36,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:36,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:36,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:36,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:36,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e65279c[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:36,813 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:36,813 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,813 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,814 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:36,814 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:36,814 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:36,814 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,814 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:36,815 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:36,815 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:36,815 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,815 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:36,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:36,819 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:36,819 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:36,819 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:36,819 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,819 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:36,821 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,821 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:36,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,821 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:36,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:36,822 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,823 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:36,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,826 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,826 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,826 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:36,826 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,826 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:36,826 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:36,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:36,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:36,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:36,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:36,826 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:36,827 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,827 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,827 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,827 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:36,827 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:36,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:36,927 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:36,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:36,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:36,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:36,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,938 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:36,938 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:36,938 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:36,938 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:36,938 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,938 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,940 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,940 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:36,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:36,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:36,941 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:36,941 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:36,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:36,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,942 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,942 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:36,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:36,942 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:36,942 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:36,942 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:36,942 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:36,942 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:36,942 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:36,942 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. started... 2023-10-31 05:53:36,942 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eaf0660ca2db156b91cead03709332e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:37,364 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122866ecf81d28824766a309d6bc90b47dd7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122866ecf81d28824766a309d6bc90b47dd7 2023-10-31 05:53:37,771 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/49ee5c99b0af438582aee489a9a526e8 2023-10-31 05:53:37,785 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/49ee5c99b0af438582aee489a9a526e8 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/49ee5c99b0af438582aee489a9a526e8 2023-10-31 05:53:37,793 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/49ee5c99b0af438582aee489a9a526e8, entries=1, sequenceid=21, filesize=4.9 K 2023-10-31 05:53:37,794 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eaf0660ca2db156b91cead03709332e6 in 852ms, sequenceid=21, compaction requested=true 2023-10-31 05:53:37,794 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:37,794 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:37,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:37,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:37,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:37,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:37,796 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,796 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:37,796 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,797 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:37,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:37,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:37,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e332b5b[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:37,799 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:37,799 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,800 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,800 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:37,801 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:37,801 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:37,801 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,801 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:37,802 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:37,802 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:37,802 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:37,802 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:37,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:37,804 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:37,804 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:37,804 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:37,804 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,804 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:37,805 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,805 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:37,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,805 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:37,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:37,805 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:37,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:37,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,806 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,808 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:37,808 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:37,808 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:37,808 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:37,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:37,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:37,808 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,808 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,808 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,808 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,808 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:37,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:37,808 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:37,908 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:37,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:37,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:37,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:37,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,922 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:37,922 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:37,922 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:37,922 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:37,923 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,923 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,924 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:37,925 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:37,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:37,925 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:37,925 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:37,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:37,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,927 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:37,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:37,927 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:37,927 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:37,927 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:37,927 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:37,927 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:37,927 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:37,927 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. started... 2023-10-31 05:53:37,927 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eaf0660ca2db156b91cead03709332e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:38,354 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231bd79f242c9d8419aba7c4e823d9b1cc0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231bd79f242c9d8419aba7c4e823d9b1cc0 2023-10-31 05:53:38,766 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/67be9ea960f04eb997dc01674d17a42b 2023-10-31 05:53:38,780 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/67be9ea960f04eb997dc01674d17a42b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/67be9ea960f04eb997dc01674d17a42b 2023-10-31 05:53:38,787 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/67be9ea960f04eb997dc01674d17a42b, entries=1, sequenceid=25, filesize=4.9 K 2023-10-31 05:53:38,788 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eaf0660ca2db156b91cead03709332e6 in 861ms, sequenceid=25, compaction requested=true 2023-10-31 05:53:38,788 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:38,788 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:38,788 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:38,788 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:38,788 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,788 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:38,788 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:38,790 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,790 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:38,790 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,790 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:38,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:38,792 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:38,792 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f16f9ce[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:38,792 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,793 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:38,793 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:38,793 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:38,793 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,793 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:38,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:38,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:38,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:38,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:38,796 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:38,796 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:38,796 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:38,796 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,796 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:38,797 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,797 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:38,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:38,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,798 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:38,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:38,798 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:38,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:38,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,799 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,801 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,801 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,801 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:38,801 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:38,801 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:38,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:38,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:38,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:38,801 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:38,801 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,801 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,801 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,801 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:38,801 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,802 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:38,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:38,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:38,902 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:38,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:38,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:38,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:38,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,918 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:38,918 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:38,918 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:38,918 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:38,918 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,918 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,920 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,920 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:38,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:38,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:38,920 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:38,920 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:38,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:38,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,922 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,922 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:38,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:38,922 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:38,922 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:38,922 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:38,923 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:38,923 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:38,923 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:38,923 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. started... 2023-10-31 05:53:38,923 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eaf0660ca2db156b91cead03709332e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:39,347 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101817ceaec201243b89b3548562580e994 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101817ceaec201243b89b3548562580e994 2023-10-31 05:53:39,756 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/ba26f163a9614c43974f1b98c9a63ee5 2023-10-31 05:53:39,767 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/ba26f163a9614c43974f1b98c9a63ee5 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/ba26f163a9614c43974f1b98c9a63ee5 2023-10-31 05:53:39,774 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/ba26f163a9614c43974f1b98c9a63ee5, entries=1, sequenceid=29, filesize=4.9 K 2023-10-31 05:53:39,775 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eaf0660ca2db156b91cead03709332e6 in 852ms, sequenceid=29, compaction requested=true 2023-10-31 05:53:39,775 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:39,775 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:39,775 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:39,775 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:39,775 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,775 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:39,776 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:39,777 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,777 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:39,778 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,778 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:39,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:39,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:39,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:39,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:39,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71dffc31[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:39,780 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:39,780 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,781 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,781 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:39,781 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:39,781 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:39,782 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,782 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:39,783 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:39,783 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,783 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:39,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:39,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:39,783 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:39,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:39,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:39,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:39,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:39,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:39,786 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:39,786 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:39,786 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:39,786 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,786 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:39,788 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,788 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:39,788 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:39,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:39,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,789 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:39,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:39,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:39,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:39,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,790 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:39,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:39,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:39,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:39,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,794 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:39,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:39,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:39,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:39,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:39,795 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:39,795 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:39,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:39,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:39,895 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:39,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:39,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:39,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:39,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,907 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:39,907 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:39,907 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:39,907 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:39,908 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,908 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,909 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:39,909 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:39,909 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:39,909 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,910 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,910 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:39,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:39,911 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:39,911 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:39,911 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:39,911 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:39,911 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:39,911 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:39,911 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. started... 2023-10-31 05:53:39,911 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eaf0660ca2db156b91cead03709332e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:40,334 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010399746b65a72c4238b4b8899924462934 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010399746b65a72c4238b4b8899924462934 2023-10-31 05:53:40,741 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/58a9bc29c86c411abd82fe10b8946d93 2023-10-31 05:53:40,746 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/58a9bc29c86c411abd82fe10b8946d93 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/58a9bc29c86c411abd82fe10b8946d93 2023-10-31 05:53:40,751 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/58a9bc29c86c411abd82fe10b8946d93, entries=1, sequenceid=33, filesize=4.9 K 2023-10-31 05:53:40,752 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eaf0660ca2db156b91cead03709332e6 in 841ms, sequenceid=33, compaction requested=true 2023-10-31 05:53:40,752 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:40,752 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:40,752 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:40,752 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:40,752 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,752 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:40,752 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:40,754 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,754 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:40,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:40,754 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:40,754 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:40,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:40,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:40,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:40,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36c17c51[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:40,755 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:40,755 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,756 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,756 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:40,756 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:40,756 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:40,756 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,756 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:40,757 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:40,757 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,757 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:40,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:40,757 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:40,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:40,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:40,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:40,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:40,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:40,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:40,759 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:40,759 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:40,759 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:40,759 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,759 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:40,760 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,760 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:40,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:40,760 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:40,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:40,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:40,761 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:40,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:40,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:40,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,769 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,780 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:40,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:40,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:40,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:40,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:40,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:40,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:40,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,780 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:40,781 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:40,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:40,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:40,881 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:40,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:40,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:40,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:40,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,888 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:40,888 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:40,888 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:40,888 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:40,888 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,888 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,889 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,889 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:40,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:40,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:40,889 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:40,889 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:40,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:40,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,890 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,891 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:40,891 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:40,891 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:40,891 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:40,891 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:40,891 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:40,891 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:40,891 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:40,891 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. started... 2023-10-31 05:53:40,891 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eaf0660ca2db156b91cead03709332e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:41,305 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ff842b8fcd724b538f7bf5818bf1988d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907ff842b8fcd724b538f7bf5818bf1988d 2023-10-31 05:53:41,711 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/21fc682bdef54701b37fbf087a954231 2023-10-31 05:53:41,717 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/21fc682bdef54701b37fbf087a954231 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/21fc682bdef54701b37fbf087a954231 2023-10-31 05:53:41,722 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/21fc682bdef54701b37fbf087a954231, entries=1, sequenceid=37, filesize=4.9 K 2023-10-31 05:53:41,723 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eaf0660ca2db156b91cead03709332e6 in 832ms, sequenceid=37, compaction requested=true 2023-10-31 05:53:41,723 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:41,723 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:41,723 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:41,723 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:41,723 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,723 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:41,723 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:41,724 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,724 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:41,725 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,725 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:41,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:41,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@118ff021[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:41,726 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:41,726 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,727 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,727 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:41,727 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:41,727 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:41,727 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,727 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:41,728 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:41,728 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,728 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:41,728 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:41,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:41,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:41,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:41,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:41,730 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:41,730 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:41,730 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:41,730 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,730 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:41,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:41,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:41,732 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,732 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:41,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,734 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:41,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:41,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:41,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:41,734 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:41,834 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:41,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:41,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:41,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:41,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,842 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:41,842 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:41,842 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-31 05:53:41,843 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-31 05:53:41,843 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,843 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,844 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:41,844 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:41,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:41,844 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:41,844 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:41,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:41,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,845 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,845 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-31 05:53:41,845 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:41,845 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-31 05:53:41,845 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:41,845 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-31 05:53:41,845 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:41,845 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:41,845 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:41,845 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. started... 2023-10-31 05:53:41,845 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing eaf0660ca2db156b91cead03709332e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:41,860 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206c3c8e63576a4d35b6334407a462c9cd to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511206c3c8e63576a4d35b6334407a462c9cd 2023-10-31 05:53:42,266 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/e68dbf30e903409e884dd9cdaf08bd7b 2023-10-31 05:53:42,271 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/e68dbf30e903409e884dd9cdaf08bd7b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/e68dbf30e903409e884dd9cdaf08bd7b 2023-10-31 05:53:42,278 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/e68dbf30e903409e884dd9cdaf08bd7b, entries=1, sequenceid=41, filesize=4.9 K 2023-10-31 05:53:42,279 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for eaf0660ca2db156b91cead03709332e6 in 434ms, sequenceid=41, compaction requested=true 2023-10-31 05:53:42,280 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:42,280 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:42,280 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:42,280 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:42,280 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,280 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-31 05:53:42,280 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-31 05:53:42,281 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,281 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:42,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:42,281 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,281 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:42,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:42,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:42,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-31 05:53:42,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@94fb357[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:42,282 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-31 05:53:42,282 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,283 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,283 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-31 05:53:42,283 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-31 05:53:42,283 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:42,283 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,283 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:42,284 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,284 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-31 05:53:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:42,284 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:42,284 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-31 05:53:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:42,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:42,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:42,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:53:42,286 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-31 05:53:42,286 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:42,286 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:42,286 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,286 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:42,287 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,287 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:42,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:42,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,287 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:42,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,288 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:42,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,289 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:42,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,293 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,293 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:42,293 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,293 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:42,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:42,293 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:42,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-31 05:53:42,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-31 05:53:42,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:42,293 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,293 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:42,293 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,293 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:42,293 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:42,294 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:42,294 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:42,394 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:42,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:42,396 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-10-31 05:53:42,398 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:53:42,398 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:53:42,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:42,399 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732222399 2023-10-31 05:53:42,404 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:53:42,405 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-31 05:53:42,405 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:42,407 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x698d7b9c to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:53:42,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65c7c453, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:53:42,411 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:42,867 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103663d37604aba4dbb8197a7b632e943bb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103663d37604aba4dbb8197a7b632e943bb 2023-10-31 05:53:42,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:42,883 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:53:42,884 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:53:42,889 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:53:42,890 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:53:42,898 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ceafa3425e1a46928c3635e3d1480a99 first=Optional[r3] last=Optional[r6] 2023-10-31 05:53:42,899 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ceafa3425e1a46928c3635e3d1480a99}] 2023-10-31 05:53:42,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ceafa3425e1a46928c3635e3d1480a99 for inclusion in eaf0660ca2db156b91cead03709332e6/family1 2023-10-31 05:53:42,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-31 05:53:42,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:42,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:42,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ceafa3425e1a46928c3635e3d1480a99 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4r533mjak180n1ian5e1lgsieiokjgubqftqnvqesso9htnhtvj05d42oi2mfjm9/family1/ceafa3425e1a46928c3635e3d1480a99 2023-10-31 05:53:42,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4r533mjak180n1ian5e1lgsieiokjgubqftqnvqesso9htnhtvj05d42oi2mfjm9/family1/ceafa3425e1a46928c3635e3d1480a99 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/42f64ebd4ab54aacad6bba6c4d193e82_SeqId_44_ 2023-10-31 05:53:42,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4r533mjak180n1ian5e1lgsieiokjgubqftqnvqesso9htnhtvj05d42oi2mfjm9/family1/ceafa3425e1a46928c3635e3d1480a99 into eaf0660ca2db156b91cead03709332e6/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/42f64ebd4ab54aacad6bba6c4d193e82_SeqId_44_ - updating store file list. 2023-10-31 05:53:42,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/42f64ebd4ab54aacad6bba6c4d193e82_SeqId_44_ into eaf0660ca2db156b91cead03709332e6/family1 2023-10-31 05:53:42,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4r533mjak180n1ian5e1lgsieiokjgubqftqnvqesso9htnhtvj05d42oi2mfjm9/family1/ceafa3425e1a46928c3635e3d1480a99 into eaf0660ca2db156b91cead03709332e6/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/42f64ebd4ab54aacad6bba6c4d193e82_SeqId_44_) 2023-10-31 05:53:42,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4r533mjak180n1ian5e1lgsieiokjgubqftqnvqesso9htnhtvj05d42oi2mfjm9/family1/ceafa3425e1a46928c3635e3d1480a99 2023-10-31 05:53:42,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-31 05:53:42,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-31 05:53:42,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): eaf0660ca2db156b91cead03709332e6/family1 is initiating minor compaction 2023-10-31 05:53:42,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5378583a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:42,917 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of eaf0660ca2db156b91cead03709332e6/family1 in testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:53:42,917 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d4204afb3ab84ae3a8d06aa60b71098f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d9f52c97a4954c029408a4a23dc615c8, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/91c23daf91364da0b8ec9984e9f7ef53, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/49ee5c99b0af438582aee489a9a526e8, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/67be9ea960f04eb997dc01674d17a42b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/ba26f163a9614c43974f1b98c9a63ee5, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/58a9bc29c86c411abd82fe10b8946d93, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/21fc682bdef54701b37fbf087a954231, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/e68dbf30e903409e884dd9cdaf08bd7b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/42f64ebd4ab54aacad6bba6c4d193e82_SeqId_44_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp, totalSize=50.0 K 2023-10-31 05:53:42,918 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting d4204afb3ab84ae3a8d06aa60b71098f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-31 05:53:42,918 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting d9f52c97a4954c029408a4a23dc615c8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-31 05:53:42,918 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 91c23daf91364da0b8ec9984e9f7ef53, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-31 05:53:42,918 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 49ee5c99b0af438582aee489a9a526e8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-31 05:53:42,918 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 67be9ea960f04eb997dc01674d17a42b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-31 05:53:42,918 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting ba26f163a9614c43974f1b98c9a63ee5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-31 05:53:42,918 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 58a9bc29c86c411abd82fe10b8946d93, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-31 05:53:42,918 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 21fc682bdef54701b37fbf087a954231, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-31 05:53:42,918 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting e68dbf30e903409e884dd9cdaf08bd7b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-31 05:53:42,918 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 42f64ebd4ab54aacad6bba6c4d193e82_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-31 05:53:42,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:42,920 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:42,922 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122866ecf81d28824766a309d6bc90b47dd7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122866ecf81d28824766a309d6bc90b47dd7 2023-10-31 05:53:42,923 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231bd79f242c9d8419aba7c4e823d9b1cc0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231bd79f242c9d8419aba7c4e823d9b1cc0 2023-10-31 05:53:42,924 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101817ceaec201243b89b3548562580e994 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101817ceaec201243b89b3548562580e994 2023-10-31 05:53:42,926 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010399746b65a72c4238b4b8899924462934 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010399746b65a72c4238b4b8899924462934 2023-10-31 05:53:42,926 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-31 05:53:42,926 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-31 05:53:42,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:42,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:42,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:42,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:42,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:42,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:42,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:42,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:42,955 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): eaf0660ca2db156b91cead03709332e6#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:53:43,394 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205df010ed6213f4a53a7b8ba59c24bfeea to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205df010ed6213f4a53a7b8ba59c24bfeea 2023-10-31 05:53:43,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:43,421 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4b2d361350984d7687fd9abd78269b90 first=Optional[r00] last=Optional[r2] 2023-10-31 05:53:43,422 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4b2d361350984d7687fd9abd78269b90}] 2023-10-31 05:53:43,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4b2d361350984d7687fd9abd78269b90 for inclusion in eaf0660ca2db156b91cead03709332e6/family1 2023-10-31 05:53:43,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-31 05:53:43,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:43,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:43,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4b2d361350984d7687fd9abd78269b90 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyPolicy__m40ntafgvlh0ai00hjs40jt6crkkapjk9c9oscae38f335730khd9sab4e59p2tf/family1/4b2d361350984d7687fd9abd78269b90 2023-10-31 05:53:43,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyPolicy__m40ntafgvlh0ai00hjs40jt6crkkapjk9c9oscae38f335730khd9sab4e59p2tf/family1/4b2d361350984d7687fd9abd78269b90 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/6105dca6948746f89f8b4e7e56cb1561_SeqId_46_ 2023-10-31 05:53:43,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyPolicy__m40ntafgvlh0ai00hjs40jt6crkkapjk9c9oscae38f335730khd9sab4e59p2tf/family1/4b2d361350984d7687fd9abd78269b90 into eaf0660ca2db156b91cead03709332e6/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/6105dca6948746f89f8b4e7e56cb1561_SeqId_46_ - updating store file list. 2023-10-31 05:53:43,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/6105dca6948746f89f8b4e7e56cb1561_SeqId_46_ into eaf0660ca2db156b91cead03709332e6/family1 2023-10-31 05:53:43,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyPolicy__m40ntafgvlh0ai00hjs40jt6crkkapjk9c9oscae38f335730khd9sab4e59p2tf/family1/4b2d361350984d7687fd9abd78269b90 into eaf0660ca2db156b91cead03709332e6/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/6105dca6948746f89f8b4e7e56cb1561_SeqId_46_) 2023-10-31 05:53:43,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyPolicy__m40ntafgvlh0ai00hjs40jt6crkkapjk9c9oscae38f335730khd9sab4e59p2tf/family1/4b2d361350984d7687fd9abd78269b90 2023-10-31 05:53:43,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:43,438 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:43,440 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c03665574b45417da1ebb221664c810d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c03665574b45417da1ebb221664c810d 2023-10-31 05:53:43,441 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201ee40d2c02cd6422da5fbf27f5faee53d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201ee40d2c02cd6422da5fbf27f5faee53d 2023-10-31 05:53:43,442 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120585d4ac82b8ca4effaa182d595a2c4255 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120585d4ac82b8ca4effaa182d595a2c4255 2023-10-31 05:53:43,442 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-10-31 05:53:43,442 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-31 05:53:43,442 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-31 05:53:43,442 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-31 05:53:43,442 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:43,443 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:53:43,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.0470 sec 2023-10-31 05:53:43,551 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=256 (was 264), OpenFileDescriptor=617 (was 626), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=190 (was 225), ProcessCount=169 (was 169), AvailableMemoryMB=1691 (was 1796) 2023-10-31 05:53:43,563 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=256, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=190, ProcessCount=169, AvailableMemoryMB=1691 2023-10-31 05:53:43,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-31 05:53:43,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:43,567 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:53:43,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-10-31 05:53:43,568 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:53:43,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-31 05:53:43,569 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1 2023-10-31 05:53:43,569 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1 empty. 2023-10-31 05:53:43,570 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1 2023-10-31 05:53:43,570 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-10-31 05:53:43,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-31 05:53:43,784 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/.tmp/family1/34c0303ce0044dc583a406cd2f216117 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/34c0303ce0044dc583a406cd2f216117 2023-10-31 05:53:43,789 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in eaf0660ca2db156b91cead03709332e6/family1 of eaf0660ca2db156b91cead03709332e6 into 34c0303ce0044dc583a406cd2f216117(size=6.6 K), total size for store is 337.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:53:43,789 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:53:43,789 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698731622917; duration=0sec 2023-10-31 05:53:43,789 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:43,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d4204afb3ab84ae3a8d06aa60b71098f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d9f52c97a4954c029408a4a23dc615c8, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/91c23daf91364da0b8ec9984e9f7ef53, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/49ee5c99b0af438582aee489a9a526e8, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/67be9ea960f04eb997dc01674d17a42b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/ba26f163a9614c43974f1b98c9a63ee5, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/58a9bc29c86c411abd82fe10b8946d93, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/21fc682bdef54701b37fbf087a954231, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/e68dbf30e903409e884dd9cdaf08bd7b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/42f64ebd4ab54aacad6bba6c4d193e82_SeqId_44_] to archive 2023-10-31 05:53:43,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:43,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d4204afb3ab84ae3a8d06aa60b71098f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d4204afb3ab84ae3a8d06aa60b71098f 2023-10-31 05:53:43,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d9f52c97a4954c029408a4a23dc615c8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/d9f52c97a4954c029408a4a23dc615c8 2023-10-31 05:53:43,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/91c23daf91364da0b8ec9984e9f7ef53 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/91c23daf91364da0b8ec9984e9f7ef53 2023-10-31 05:53:43,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/49ee5c99b0af438582aee489a9a526e8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/49ee5c99b0af438582aee489a9a526e8 2023-10-31 05:53:43,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/67be9ea960f04eb997dc01674d17a42b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/67be9ea960f04eb997dc01674d17a42b 2023-10-31 05:53:43,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/ba26f163a9614c43974f1b98c9a63ee5 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/ba26f163a9614c43974f1b98c9a63ee5 2023-10-31 05:53:43,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/58a9bc29c86c411abd82fe10b8946d93 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/58a9bc29c86c411abd82fe10b8946d93 2023-10-31 05:53:43,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/21fc682bdef54701b37fbf087a954231 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/21fc682bdef54701b37fbf087a954231 2023-10-31 05:53:43,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/e68dbf30e903409e884dd9cdaf08bd7b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/e68dbf30e903409e884dd9cdaf08bd7b 2023-10-31 05:53:43,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/42f64ebd4ab54aacad6bba6c4d193e82_SeqId_44_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/family1/42f64ebd4ab54aacad6bba6c4d193e82_SeqId_44_ 2023-10-31 05:53:43,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-31 05:53:43,977 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-31 05:53:43,978 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => f0080370107a624806071940a49aebd1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:53:44,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-31 05:53:44,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:44,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing f0080370107a624806071940a49aebd1, disabling compactions & flushes 2023-10-31 05:53:44,383 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:44,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:44,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. after waiting 0 ms 2023-10-31 05:53:44,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:44,383 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:44,383 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:44,387 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:53:44,388 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731624388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731624388"}]},"ts":"1698731624388"} 2023-10-31 05:53:44,389 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-31 05:53:44,390 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:53:44,390 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731624390"}]},"ts":"1698731624390"} 2023-10-31 05:53:44,391 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-10-31 05:53:44,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, ASSIGN}] 2023-10-31 05:53:44,395 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, ASSIGN 2023-10-31 05:53:44,396 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:53:44,547 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=f0080370107a624806071940a49aebd1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:44,547 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731624547"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731624547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731624547"}]},"ts":"1698731624547"} 2023-10-31 05:53:44,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure f0080370107a624806071940a49aebd1, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:44,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-31 05:53:44,701 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:44,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:44,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0080370107a624806071940a49aebd1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:53:44,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly f0080370107a624806071940a49aebd1 2023-10-31 05:53:44,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:44,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f0080370107a624806071940a49aebd1 2023-10-31 05:53:44,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f0080370107a624806071940a49aebd1 2023-10-31 05:53:44,705 INFO [StoreOpener-f0080370107a624806071940a49aebd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f0080370107a624806071940a49aebd1 2023-10-31 05:53:44,706 DEBUG [StoreOpener-f0080370107a624806071940a49aebd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:44,706 DEBUG [StoreOpener-f0080370107a624806071940a49aebd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:44,707 INFO [StoreOpener-f0080370107a624806071940a49aebd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0080370107a624806071940a49aebd1 columnFamilyName family1 2023-10-31 05:53:44,708 INFO [StoreOpener-f0080370107a624806071940a49aebd1-1] regionserver.HStore(310): Store=f0080370107a624806071940a49aebd1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:44,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1 2023-10-31 05:53:44,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1 2023-10-31 05:53:44,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f0080370107a624806071940a49aebd1 2023-10-31 05:53:44,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:53:44,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f0080370107a624806071940a49aebd1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71868598, jitterRate=0.07092556357383728}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:53:44,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:44,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1., pid=41, masterSystemTime=1698731624700 2023-10-31 05:53:44,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:44,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:44,718 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=f0080370107a624806071940a49aebd1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:44,718 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731624718"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731624718"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731624718"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731624718"}]},"ts":"1698731624718"} 2023-10-31 05:53:44,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-10-31 05:53:44,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure f0080370107a624806071940a49aebd1, server=jenkins-hbase20.apache.org,43723,1698731565849 in 171 msec 2023-10-31 05:53:44,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-10-31 05:53:44,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, ASSIGN in 329 msec 2023-10-31 05:53:44,725 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:53:44,725 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731624725"}]},"ts":"1698731624725"} 2023-10-31 05:53:44,726 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-10-31 05:53:44,728 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:53:44,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1630 sec 2023-10-31 05:53:45,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-31 05:53:45,674 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-10-31 05:53:45,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:45,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:45,711 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:45,711 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:45,711 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-31 05:53:45,711 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-31 05:53:45,711 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:45,711 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:45,712 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:45,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:45,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:45,712 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:45,712 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:45,712 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:45,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:45,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:45,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:45,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:45,713 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:45,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:45,714 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-31 05:53:45,714 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:45,714 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-31 05:53:45,722 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:45,723 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:45,723 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:45,723 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. started... 2023-10-31 05:53:45,723 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0080370107a624806071940a49aebd1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-31 05:53:46,154 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a04b1ff484c5414f86c77c61a702a2e9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130a04b1ff484c5414f86c77c61a702a2e9 2023-10-31 05:53:46,158 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/e0747d6ed1314794967ba5c3c6eba692 2023-10-31 05:53:46,163 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/e0747d6ed1314794967ba5c3c6eba692 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/e0747d6ed1314794967ba5c3c6eba692 2023-10-31 05:53:46,167 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/e0747d6ed1314794967ba5c3c6eba692, entries=1000, sequenceid=5, filesize=191.4 K 2023-10-31 05:53:46,168 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f0080370107a624806071940a49aebd1 in 445ms, sequenceid=5, compaction requested=false 2023-10-31 05:53:46,168 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:46,169 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:46,169 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:46,169 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:46,169 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:46,169 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,169 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-31 05:53:46,169 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-31 05:53:46,170 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,170 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:46,170 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,170 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:46,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-31 05:53:46,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77fe83b[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:46,172 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-31 05:53:46,172 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,172 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,173 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-31 05:53:46,173 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-31 05:53:46,173 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:46,173 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,173 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:46,173 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,173 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-31 05:53:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:46,173 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:46,173 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-31 05:53:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:46,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-31 05:53:46,175 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-31 05:53:46,175 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:46,175 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:46,175 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,175 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:46,176 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,176 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:46,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,176 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:46,177 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,177 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,179 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,179 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,179 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:46,179 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:46,179 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:46,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:46,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:46,179 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:46,179 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,179 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,179 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-31 05:53:46,179 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:46,179 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:46,180 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:46,280 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:46,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:46,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:46,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:46,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,287 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:46,287 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:46,287 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-31 05:53:46,287 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-31 05:53:46,288 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,288 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,289 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:46,289 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:46,289 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,289 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,290 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,290 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-31 05:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,290 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-31 05:53:46,290 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:46,290 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-31 05:53:46,290 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:46,290 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:46,290 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:46,290 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. started... 2023-10-31 05:53:46,291 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0080370107a624806071940a49aebd1 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-31 05:53:46,711 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d444a1fc449548899f82601f34eebd02 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d444a1fc449548899f82601f34eebd02 2023-10-31 05:53:46,721 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/15983cc9d4de4e6d85456e40318e7cac 2023-10-31 05:53:46,730 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/15983cc9d4de4e6d85456e40318e7cac as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/15983cc9d4de4e6d85456e40318e7cac 2023-10-31 05:53:46,739 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/15983cc9d4de4e6d85456e40318e7cac, entries=1, sequenceid=9, filesize=5.0 K 2023-10-31 05:53:46,740 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f0080370107a624806071940a49aebd1 in 449ms, sequenceid=9, compaction requested=false 2023-10-31 05:53:46,741 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:46,741 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:46,741 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:46,741 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:46,741 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,741 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-31 05:53:46,741 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-31 05:53:46,743 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,743 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:46,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:46,743 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,743 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:46,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:46,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:46,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:46,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-31 05:53:46,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ae12f71[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:46,748 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-31 05:53:46,748 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,758 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,758 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,758 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:46,758 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-31 05:53:46,758 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-31 05:53:46,758 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:46,763 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,763 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-31 05:53:46,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:46,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:46,763 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:46,763 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-31 05:53:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:46,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:46,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-31 05:53:46,766 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-31 05:53:46,766 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:46,766 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:46,766 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,766 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:46,767 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,767 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:46,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,767 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:46,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:46,767 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,768 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:46,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,771 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,771 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:46,771 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:46,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:46,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:46,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-31 05:53:46,771 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:46,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:46,771 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:46,772 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,772 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,772 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,772 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,772 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,772 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:46,772 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:46,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:46,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:46,872 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:46,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:46,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:46,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:46,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,879 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:46,879 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:46,879 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-31 05:53:46,879 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-31 05:53:46,879 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,879 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,880 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:46,880 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:46,880 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:46,880 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:46,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,881 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,881 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-31 05:53:46,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:46,881 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-31 05:53:46,881 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:46,881 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-31 05:53:46,881 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:46,881 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:46,881 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:46,881 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. started... 2023-10-31 05:53:46,881 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0080370107a624806071940a49aebd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:47,303 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ddf8a6e60d5b470fa70620ef85b650bc to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ddf8a6e60d5b470fa70620ef85b650bc 2023-10-31 05:53:47,711 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/b27e1d84a2714a2597f06250fedd3267 2023-10-31 05:53:47,716 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/b27e1d84a2714a2597f06250fedd3267 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/b27e1d84a2714a2597f06250fedd3267 2023-10-31 05:53:47,719 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/b27e1d84a2714a2597f06250fedd3267, entries=1, sequenceid=13, filesize=5.0 K 2023-10-31 05:53:47,720 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0080370107a624806071940a49aebd1 in 839ms, sequenceid=13, compaction requested=true 2023-10-31 05:53:47,720 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:47,720 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:47,720 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:47,720 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:47,720 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,720 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-31 05:53:47,720 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-31 05:53:47,721 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,721 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:47,722 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,722 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:47,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-31 05:53:47,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5401def4[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:47,723 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-31 05:53:47,723 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,724 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,724 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-31 05:53:47,724 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-31 05:53:47,724 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:47,724 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,724 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:47,725 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,725 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-31 05:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:47,725 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:47,725 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-31 05:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:47,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:47,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-31 05:53:47,727 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-31 05:53:47,727 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:47,727 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:47,727 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,727 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:47,728 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,728 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:47,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:47,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,728 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:47,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:47,728 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,729 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:47,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:47,731 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:47,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:47,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:47,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:47,731 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:47,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:47,832 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:47,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:47,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:47,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:47,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,843 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:47,843 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:47,843 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-31 05:53:47,843 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-31 05:53:47,844 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,844 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,845 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,845 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:47,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:47,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:47,845 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:47,845 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:47,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:47,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,846 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,846 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-31 05:53:47,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:47,846 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-31 05:53:47,846 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:47,846 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-31 05:53:47,846 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:47,846 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:47,846 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:47,846 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. started... 2023-10-31 05:53:47,846 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0080370107a624806071940a49aebd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:48,259 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057d13f68a0b8b49e8af764d5a2497cf34 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512057d13f68a0b8b49e8af764d5a2497cf34 2023-10-31 05:53:48,665 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/123a643ecfb44c07b02f4e72d1522f4f 2023-10-31 05:53:48,669 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/123a643ecfb44c07b02f4e72d1522f4f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/123a643ecfb44c07b02f4e72d1522f4f 2023-10-31 05:53:48,674 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/123a643ecfb44c07b02f4e72d1522f4f, entries=1, sequenceid=17, filesize=5.0 K 2023-10-31 05:53:48,675 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0080370107a624806071940a49aebd1 in 829ms, sequenceid=17, compaction requested=true 2023-10-31 05:53:48,675 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:48,675 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:48,675 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:48,675 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:48,675 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,675 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-31 05:53:48,675 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-31 05:53:48,676 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,676 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:48,677 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,677 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:48,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-31 05:53:48,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20201a28[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:48,678 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-31 05:53:48,678 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,678 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,678 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-31 05:53:48,678 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-31 05:53:48,678 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:48,678 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,678 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:48,679 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-31 05:53:48,679 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,679 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:48,679 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-31 05:53:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-31 05:53:48,681 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-31 05:53:48,681 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:48,681 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:48,681 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,681 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:48,682 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,682 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:48,682 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,683 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,684 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,685 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,685 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,685 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:48,685 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:48,685 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:48,685 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:48,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:48,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:48,685 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,686 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,686 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,686 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,686 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:48,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:48,686 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:48,786 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:48,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:48,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:48,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:48,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,792 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:48,792 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:48,792 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-31 05:53:48,792 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-31 05:53:48,793 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,793 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,796 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,796 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:48,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:48,796 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:48,796 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:48,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,797 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,797 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-31 05:53:48,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:48,797 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-31 05:53:48,797 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:48,797 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-31 05:53:48,797 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:48,797 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:48,797 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:48,797 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. started... 2023-10-31 05:53:48,798 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0080370107a624806071940a49aebd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:49,213 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512287ebd84473ca840719c8dfead23330674 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512287ebd84473ca840719c8dfead23330674 2023-10-31 05:53:49,624 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/3d0db85c091b456f8b0f2428b456d2c4 2023-10-31 05:53:49,635 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/3d0db85c091b456f8b0f2428b456d2c4 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/3d0db85c091b456f8b0f2428b456d2c4 2023-10-31 05:53:49,639 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/3d0db85c091b456f8b0f2428b456d2c4, entries=1, sequenceid=21, filesize=5.0 K 2023-10-31 05:53:49,640 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0080370107a624806071940a49aebd1 in 843ms, sequenceid=21, compaction requested=true 2023-10-31 05:53:49,640 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:49,640 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:49,640 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:49,640 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:49,640 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,640 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-31 05:53:49,640 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-31 05:53:49,641 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,641 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:49,642 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,642 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:49,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-31 05:53:49,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58661027[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:49,643 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-31 05:53:49,643 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,644 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,644 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-31 05:53:49,644 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-31 05:53:49,644 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:49,644 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,644 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:49,645 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-31 05:53:49,645 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,645 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:49,645 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-31 05:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:49,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-31 05:53:49,647 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-31 05:53:49,647 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:49,647 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:49,647 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,647 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:49,648 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,648 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,648 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:49,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:49,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:49,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:49,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:49,649 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,650 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,651 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,651 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,651 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:49,651 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:49,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:49,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:49,651 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:49,651 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:49,651 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,652 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-31 05:53:49,652 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:49,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:49,652 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,652 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:49,652 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,752 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:49,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:49,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:49,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:49,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,760 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:49,760 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:49,760 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-31 05:53:49,760 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-31 05:53:49,761 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,761 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,762 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,762 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:49,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:49,762 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:49,762 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,764 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-31 05:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:49,764 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-31 05:53:49,764 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:49,764 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-31 05:53:49,764 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:49,764 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:49,765 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:49,765 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. started... 2023-10-31 05:53:49,765 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0080370107a624806071940a49aebd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:50,184 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d3d14113e15f4f98945c885a81df87dc to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231d3d14113e15f4f98945c885a81df87dc 2023-10-31 05:53:50,232 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:53:50,593 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/eb783ea598264708a24805ceabbaf490 2023-10-31 05:53:50,605 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/eb783ea598264708a24805ceabbaf490 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/eb783ea598264708a24805ceabbaf490 2023-10-31 05:53:50,611 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/eb783ea598264708a24805ceabbaf490, entries=1, sequenceid=25, filesize=5.0 K 2023-10-31 05:53:50,611 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0080370107a624806071940a49aebd1 in 846ms, sequenceid=25, compaction requested=true 2023-10-31 05:53:50,612 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:50,612 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:50,612 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:50,612 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:50,612 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,612 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-31 05:53:50,612 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-31 05:53:50,613 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,613 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:50,614 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,614 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:50,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-31 05:53:50,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bcf26fd[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:50,617 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-31 05:53:50,617 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,624 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,624 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-31 05:53:50,624 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-31 05:53:50,624 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:50,625 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,625 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:50,629 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-31 05:53:50,629 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:50,629 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-31 05:53:50,629 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:50,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:50,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:50,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-31 05:53:50,634 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-31 05:53:50,634 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:50,634 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:50,634 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,634 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:50,641 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,641 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,641 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:50,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:50,642 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:50,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:50,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,644 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:50,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,649 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,649 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:50,649 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:50,649 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,649 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:50,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-31 05:53:50,650 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:50,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:50,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:50,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:50,650 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,650 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,650 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:50,651 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:50,650 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:50,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:50,651 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,751 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:50,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:50,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:50,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:50,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,759 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:50,759 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:50,759 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-31 05:53:50,759 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-31 05:53:50,760 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,760 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,761 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,761 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:50,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:50,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:50,761 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:50,762 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,763 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,763 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-31 05:53:50,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:50,763 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-31 05:53:50,763 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:50,763 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-31 05:53:50,763 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:50,763 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:50,763 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:50,764 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. started... 2023-10-31 05:53:50,764 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0080370107a624806071940a49aebd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:51,179 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d8a0ea16d9a648d792e01f35da1a96e8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101d8a0ea16d9a648d792e01f35da1a96e8 2023-10-31 05:53:51,586 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/539ce00c3a4f401d8a30b50ef740850b 2023-10-31 05:53:51,600 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/539ce00c3a4f401d8a30b50ef740850b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/539ce00c3a4f401d8a30b50ef740850b 2023-10-31 05:53:51,608 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/539ce00c3a4f401d8a30b50ef740850b, entries=1, sequenceid=29, filesize=5.0 K 2023-10-31 05:53:51,609 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0080370107a624806071940a49aebd1 in 845ms, sequenceid=29, compaction requested=true 2023-10-31 05:53:51,610 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:51,610 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:51,610 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:51,610 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:51,610 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,610 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-31 05:53:51,610 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-31 05:53:51,611 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,611 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:51,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:51,612 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:51,612 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:51,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:51,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:51,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-31 05:53:51,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31e3a30e[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:51,613 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-31 05:53:51,613 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,614 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,614 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-31 05:53:51,614 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-31 05:53:51,614 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:51,614 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,614 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:51,616 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-31 05:53:51,616 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,616 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:51,616 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-31 05:53:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:51,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-31 05:53:51,619 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-31 05:53:51,619 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:51,619 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:51,619 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,619 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:51,621 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,621 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:51,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,621 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:51,621 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,622 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:51,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:51,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,624 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:51,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:51,624 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:51,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:51,725 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:51,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:51,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:51,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:51,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,731 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:51,731 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:51,731 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-31 05:53:51,731 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-31 05:53:51,732 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,732 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,733 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,733 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:51,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:51,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:51,733 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:51,733 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:51,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:51,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-31 05:53:51,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:51,735 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-31 05:53:51,735 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:51,735 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-31 05:53:51,735 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:51,735 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:51,735 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:51,735 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. started... 2023-10-31 05:53:51,735 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0080370107a624806071940a49aebd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:52,149 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ddf726967cc44c5791c723f7f7737631 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103ddf726967cc44c5791c723f7f7737631 2023-10-31 05:53:52,557 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/2a13bafa9279463bb22bcb6c27ed9bbc 2023-10-31 05:53:52,569 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/2a13bafa9279463bb22bcb6c27ed9bbc as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/2a13bafa9279463bb22bcb6c27ed9bbc 2023-10-31 05:53:52,575 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/2a13bafa9279463bb22bcb6c27ed9bbc, entries=1, sequenceid=33, filesize=5.0 K 2023-10-31 05:53:52,576 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0080370107a624806071940a49aebd1 in 841ms, sequenceid=33, compaction requested=true 2023-10-31 05:53:52,576 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:52,576 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:52,576 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:52,576 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:52,576 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,576 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-31 05:53:52,576 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-31 05:53:52,578 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,578 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:52,578 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,578 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:52,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-31 05:53:52,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11321e40[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:52,580 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-31 05:53:52,581 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,581 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,582 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-31 05:53:52,582 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-31 05:53:52,582 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:52,582 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,582 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:52,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-31 05:53:52,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:52,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-31 05:53:52,583 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:52,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:52,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-31 05:53:52,586 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-31 05:53:52,586 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:52,586 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:52,586 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,586 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:52,587 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,587 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:52,587 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:52,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:52,588 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,589 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:52,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,591 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,591 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:52,591 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:52,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:52,591 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,592 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,592 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,592 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,592 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,591 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:52,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-31 05:53:52,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:52,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:52,591 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:52,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:52,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:52,592 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:52,592 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:52,692 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:52,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:52,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:52,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:52,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,702 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:52,702 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:52,702 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-31 05:53:52,702 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-31 05:53:52,703 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,703 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,705 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:52,705 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:52,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:52,705 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:52,705 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,707 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,708 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-31 05:53:52,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:52,708 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-31 05:53:52,708 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:52,708 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-31 05:53:52,708 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:52,708 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:52,708 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:52,708 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. started... 2023-10-31 05:53:52,709 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0080370107a624806071940a49aebd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:53,129 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a99d4c60419047c3be234a7adf73a5ce to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907a99d4c60419047c3be234a7adf73a5ce 2023-10-31 05:53:53,537 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/8fdf7aef8e544b8eadeedb43e64ed818 2023-10-31 05:53:53,543 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/8fdf7aef8e544b8eadeedb43e64ed818 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/8fdf7aef8e544b8eadeedb43e64ed818 2023-10-31 05:53:53,547 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/8fdf7aef8e544b8eadeedb43e64ed818, entries=1, sequenceid=37, filesize=5.0 K 2023-10-31 05:53:53,548 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0080370107a624806071940a49aebd1 in 839ms, sequenceid=37, compaction requested=true 2023-10-31 05:53:53,548 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:53,548 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:53,548 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:53,549 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:53,549 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,549 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-31 05:53:53,549 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-31 05:53:53,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,550 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:53,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:53,550 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,550 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:53,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:53,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:53,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:53,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-31 05:53:53,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79bdc369[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:53,551 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-31 05:53:53,551 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,552 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,552 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,552 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:53,552 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-31 05:53:53,552 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-31 05:53:53,552 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:53,553 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-31 05:53:53,553 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,553 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:53,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,553 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-31 05:53:53,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:53,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:53,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:53,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:53,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:53,555 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-31 05:53:53,555 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:53,555 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:53,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-31 05:53:53,555 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,555 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:53,556 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,556 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:53,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,557 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:53,557 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:53,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,558 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:53,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,560 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,560 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:53,560 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:53,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:53,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:53,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:53,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-31 05:53:53,560 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:53,560 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,560 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:53,561 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:53,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:53,561 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:53,561 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:53,561 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,561 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,561 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,661 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:53,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:53,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:53:53,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-31 05:53:53,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,668 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:53,668 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:53,668 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-31 05:53:53,668 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-31 05:53:53,669 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,669 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,669 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:53,669 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:53,670 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,670 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:53:53,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,670 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,671 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-31 05:53:53,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:53,671 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-31 05:53:53,671 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:53:53,671 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-31 05:53:53,671 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:53:53,671 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:53:53,671 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:53,671 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. started... 2023-10-31 05:53:53,671 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f0080370107a624806071940a49aebd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:53:54,084 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202bfdc5bd30504a99bcb08a6a479e3a65 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511202bfdc5bd30504a99bcb08a6a479e3a65 2023-10-31 05:53:54,490 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/fc9cecebf2dd4511bf52688ddfbe9944 2023-10-31 05:53:54,496 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/fc9cecebf2dd4511bf52688ddfbe9944 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/fc9cecebf2dd4511bf52688ddfbe9944 2023-10-31 05:53:54,500 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/fc9cecebf2dd4511bf52688ddfbe9944, entries=1, sequenceid=41, filesize=5.0 K 2023-10-31 05:53:54,501 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f0080370107a624806071940a49aebd1 in 830ms, sequenceid=41, compaction requested=true 2023-10-31 05:53:54,501 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:54,501 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:54,501 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:53:54,501 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:53:54,501 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,501 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-31 05:53:54,501 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-31 05:53:54,502 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,502 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:54,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:54,503 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,503 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:53:54,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:54,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:54,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:54,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-31 05:53:54,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b57ea6d[Count = 0] remaining members to acquire global barrier 2023-10-31 05:53:54,504 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-31 05:53:54,504 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,504 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,504 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-31 05:53:54,504 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-31 05:53:54,504 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:53:54,504 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,504 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:53:54,505 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,505 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-31 05:53:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:54,505 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:54,505 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-31 05:53:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:53:54,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-31 05:53:54,507 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-31 05:53:54,507 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:53:54,507 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:53:54,507 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,507 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:53:54,508 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,508 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:53:54,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:53:54,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,508 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:54,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:53:54,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:54,509 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:54,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:53:54,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,514 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:53:54,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,529 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,529 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,529 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,529 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:53:54,530 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:53:54,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-31 05:53:54,530 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:54,530 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:53:54,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:53:54,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-31 05:53:54,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:53:54,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:53:54,530 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,530 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,530 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,530 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-31 05:53:54,530 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:53:54,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:53:54,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:53:54,630 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:53:54,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:53:54,633 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:54,634 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:54,635 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:54,636 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:54,636 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732234636 2023-10-31 05:53:54,639 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:53:54,640 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-31 05:53:54,640 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:54,641 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x04a68b9a to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:53:54,648 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@466424ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:53:54,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:55,492 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103316b9f0002f842b683928aba44337b46 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103316b9f0002f842b683928aba44337b46 2023-10-31 05:53:55,493 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:55,510 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:53:55,511 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:53:55,518 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:53:55,520 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:53:55,534 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ca87fcdaa146439c8b0b91a3c9563803 first=Optional[r3] last=Optional[r6] 2023-10-31 05:53:55,535 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ca87fcdaa146439c8b0b91a3c9563803}] 2023-10-31 05:53:55,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ca87fcdaa146439c8b0b91a3c9563803 for inclusion in f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:55,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-31 05:53:55,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:55,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:55,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ca87fcdaa146439c8b0b91a3c9563803 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fjkivu7b2a9ichge7ampddkmqg0f0fqtf7r7uim6c5t2gb7ojn8su6ssipiu3stj/family1/ca87fcdaa146439c8b0b91a3c9563803 2023-10-31 05:53:55,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fjkivu7b2a9ichge7ampddkmqg0f0fqtf7r7uim6c5t2gb7ojn8su6ssipiu3stj/family1/ca87fcdaa146439c8b0b91a3c9563803 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/19b0b16353104a62b525711cedcb9c6c_SeqId_44_ 2023-10-31 05:53:55,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fjkivu7b2a9ichge7ampddkmqg0f0fqtf7r7uim6c5t2gb7ojn8su6ssipiu3stj/family1/ca87fcdaa146439c8b0b91a3c9563803 into f0080370107a624806071940a49aebd1/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/19b0b16353104a62b525711cedcb9c6c_SeqId_44_ - updating store file list. 2023-10-31 05:53:55,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/19b0b16353104a62b525711cedcb9c6c_SeqId_44_ into f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:55,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fjkivu7b2a9ichge7ampddkmqg0f0fqtf7r7uim6c5t2gb7ojn8su6ssipiu3stj/family1/ca87fcdaa146439c8b0b91a3c9563803 into f0080370107a624806071940a49aebd1/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/19b0b16353104a62b525711cedcb9c6c_SeqId_44_) 2023-10-31 05:53:55,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fjkivu7b2a9ichge7ampddkmqg0f0fqtf7r7uim6c5t2gb7ojn8su6ssipiu3stj/family1/ca87fcdaa146439c8b0b91a3c9563803 2023-10-31 05:53:55,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-31 05:53:55,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-31 05:53:55,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): f0080370107a624806071940a49aebd1/family1 is initiating minor compaction 2023-10-31 05:53:55,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7610c387; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:55,557 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f0080370107a624806071940a49aebd1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:55,557 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/15983cc9d4de4e6d85456e40318e7cac, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/b27e1d84a2714a2597f06250fedd3267, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/123a643ecfb44c07b02f4e72d1522f4f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/3d0db85c091b456f8b0f2428b456d2c4, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/eb783ea598264708a24805ceabbaf490, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/539ce00c3a4f401d8a30b50ef740850b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/2a13bafa9279463bb22bcb6c27ed9bbc, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/8fdf7aef8e544b8eadeedb43e64ed818, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/fc9cecebf2dd4511bf52688ddfbe9944, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/19b0b16353104a62b525711cedcb9c6c_SeqId_44_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp, totalSize=50.4 K 2023-10-31 05:53:55,558 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 15983cc9d4de4e6d85456e40318e7cac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-31 05:53:55,558 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting b27e1d84a2714a2597f06250fedd3267, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-31 05:53:55,558 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 123a643ecfb44c07b02f4e72d1522f4f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-31 05:53:55,558 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 3d0db85c091b456f8b0f2428b456d2c4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-31 05:53:55,558 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting eb783ea598264708a24805ceabbaf490, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-31 05:53:55,558 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 539ce00c3a4f401d8a30b50ef740850b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-31 05:53:55,558 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 2a13bafa9279463bb22bcb6c27ed9bbc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-31 05:53:55,558 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 8fdf7aef8e544b8eadeedb43e64ed818, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-31 05:53:55,558 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting fc9cecebf2dd4511bf52688ddfbe9944, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-31 05:53:55,558 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 19b0b16353104a62b525711cedcb9c6c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-31 05:53:55,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:55,575 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:55,579 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512287ebd84473ca840719c8dfead23330674 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512287ebd84473ca840719c8dfead23330674 2023-10-31 05:53:55,580 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231d3d14113e15f4f98945c885a81df87dc to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231d3d14113e15f4f98945c885a81df87dc 2023-10-31 05:53:55,581 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101d8a0ea16d9a648d792e01f35da1a96e8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101d8a0ea16d9a648d792e01f35da1a96e8 2023-10-31 05:53:55,582 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103ddf726967cc44c5791c723f7f7737631 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103ddf726967cc44c5791c723f7f7737631 2023-10-31 05:53:55,582 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-10-31 05:53:55,582 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-31 05:53:55,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:55,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:55,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:55,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:55,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:55,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:55,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:55,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:55,605 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): f0080370107a624806071940a49aebd1#family1#compaction#60 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:53:56,054 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/526d509dd264416b874e0685529d5412 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/526d509dd264416b874e0685529d5412 2023-10-31 05:53:56,062 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f0080370107a624806071940a49aebd1/family1 of f0080370107a624806071940a49aebd1 into 526d509dd264416b874e0685529d5412(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:53:56,062 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:56,062 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698731635557; duration=0sec 2023-10-31 05:53:56,062 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:56,078 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052eda4107e5f549a7b47cfedb12869be8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512052eda4107e5f549a7b47cfedb12869be8 2023-10-31 05:53:56,079 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:56,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/15983cc9d4de4e6d85456e40318e7cac, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/b27e1d84a2714a2597f06250fedd3267, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/123a643ecfb44c07b02f4e72d1522f4f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/3d0db85c091b456f8b0f2428b456d2c4, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/eb783ea598264708a24805ceabbaf490, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/539ce00c3a4f401d8a30b50ef740850b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/2a13bafa9279463bb22bcb6c27ed9bbc, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/8fdf7aef8e544b8eadeedb43e64ed818, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/fc9cecebf2dd4511bf52688ddfbe9944, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/19b0b16353104a62b525711cedcb9c6c_SeqId_44_] to archive 2023-10-31 05:53:56,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:56,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/15983cc9d4de4e6d85456e40318e7cac to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/15983cc9d4de4e6d85456e40318e7cac 2023-10-31 05:53:56,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/b27e1d84a2714a2597f06250fedd3267 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/b27e1d84a2714a2597f06250fedd3267 2023-10-31 05:53:56,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/123a643ecfb44c07b02f4e72d1522f4f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/123a643ecfb44c07b02f4e72d1522f4f 2023-10-31 05:53:56,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/3d0db85c091b456f8b0f2428b456d2c4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/3d0db85c091b456f8b0f2428b456d2c4 2023-10-31 05:53:56,125 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ade04342b0534bfc9a512a92014ced28 first=Optional[r00] last=Optional[r2] 2023-10-31 05:53:56,126 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ade04342b0534bfc9a512a92014ced28}] 2023-10-31 05:53:56,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/eb783ea598264708a24805ceabbaf490 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/eb783ea598264708a24805ceabbaf490 2023-10-31 05:53:56,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ade04342b0534bfc9a512a92014ced28 for inclusion in f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:56,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/539ce00c3a4f401d8a30b50ef740850b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/539ce00c3a4f401d8a30b50ef740850b 2023-10-31 05:53:56,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/2a13bafa9279463bb22bcb6c27ed9bbc to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/2a13bafa9279463bb22bcb6c27ed9bbc 2023-10-31 05:53:56,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-31 05:53:56,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:56,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:56,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ade04342b0534bfc9a512a92014ced28 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lloldn3eib1qihccfpbej4uignis6d0rj7dgll7o3gk0lhb3bkj4egpkdspeab7q/family1/ade04342b0534bfc9a512a92014ced28 2023-10-31 05:53:56,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/8fdf7aef8e544b8eadeedb43e64ed818 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/8fdf7aef8e544b8eadeedb43e64ed818 2023-10-31 05:53:56,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/fc9cecebf2dd4511bf52688ddfbe9944 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/fc9cecebf2dd4511bf52688ddfbe9944 2023-10-31 05:53:56,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/19b0b16353104a62b525711cedcb9c6c_SeqId_44_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/19b0b16353104a62b525711cedcb9c6c_SeqId_44_ 2023-10-31 05:53:56,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lloldn3eib1qihccfpbej4uignis6d0rj7dgll7o3gk0lhb3bkj4egpkdspeab7q/family1/ade04342b0534bfc9a512a92014ced28 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/86046bb665ac42aa91f041dba606d188_SeqId_47_ 2023-10-31 05:53:56,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lloldn3eib1qihccfpbej4uignis6d0rj7dgll7o3gk0lhb3bkj4egpkdspeab7q/family1/ade04342b0534bfc9a512a92014ced28 into f0080370107a624806071940a49aebd1/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/86046bb665ac42aa91f041dba606d188_SeqId_47_ - updating store file list. 2023-10-31 05:53:56,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/86046bb665ac42aa91f041dba606d188_SeqId_47_ into f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:56,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lloldn3eib1qihccfpbej4uignis6d0rj7dgll7o3gk0lhb3bkj4egpkdspeab7q/family1/ade04342b0534bfc9a512a92014ced28 into f0080370107a624806071940a49aebd1/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/86046bb665ac42aa91f041dba606d188_SeqId_47_) 2023-10-31 05:53:56,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lloldn3eib1qihccfpbej4uignis6d0rj7dgll7o3gk0lhb3bkj4egpkdspeab7q/family1/ade04342b0534bfc9a512a92014ced28 2023-10-31 05:53:56,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-31 05:53:56,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-31 05:53:56,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): f0080370107a624806071940a49aebd1/family1 is initiating minor compaction (all files) 2023-10-31 05:53:56,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@42d1b712; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:56,144 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f0080370107a624806071940a49aebd1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:56,145 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/e0747d6ed1314794967ba5c3c6eba692, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/526d509dd264416b874e0685529d5412, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/86046bb665ac42aa91f041dba606d188_SeqId_47_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp, totalSize=390.1 K 2023-10-31 05:53:56,145 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting e0747d6ed1314794967ba5c3c6eba692, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878848969 2023-10-31 05:53:56,146 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 526d509dd264416b874e0685529d5412, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621248969 2023-10-31 05:53:56,147 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 86046bb665ac42aa91f041dba606d188_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878848969 2023-10-31 05:53:56,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:56,149 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:56,152 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130a04b1ff484c5414f86c77c61a702a2e9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130a04b1ff484c5414f86c77c61a702a2e9 2023-10-31 05:53:56,155 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ddf8a6e60d5b470fa70620ef85b650bc to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ddf8a6e60d5b470fa70620ef85b650bc 2023-10-31 05:53:56,156 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512057d13f68a0b8b49e8af764d5a2497cf34 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512057d13f68a0b8b49e8af764d5a2497cf34 2023-10-31 05:53:56,157 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-10-31 05:53:56,157 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-31 05:53:56,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:56,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:56,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:56,163 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:56,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.5300 sec 2023-10-31 05:53:56,184 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): f0080370107a624806071940a49aebd1#family1#compaction#61 average throughput is 12.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:53:56,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-31 05:53:56,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:56,657 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/.tmp/family1/3ada3ecd4ce648c48fc215c3d0d764cf as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/3ada3ecd4ce648c48fc215c3d0d764cf 2023-10-31 05:53:56,662 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f0080370107a624806071940a49aebd1/family1 of f0080370107a624806071940a49aebd1 into 3ada3ecd4ce648c48fc215c3d0d764cf(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:53:56,662 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:56,662 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1698731636144; duration=0sec 2023-10-31 05:53:56,662 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:53:56,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/e0747d6ed1314794967ba5c3c6eba692, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/526d509dd264416b874e0685529d5412, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/86046bb665ac42aa91f041dba606d188_SeqId_47_] to archive 2023-10-31 05:53:56,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:56,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/e0747d6ed1314794967ba5c3c6eba692 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/e0747d6ed1314794967ba5c3c6eba692 2023-10-31 05:53:56,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/526d509dd264416b874e0685529d5412 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/526d509dd264416b874e0685529d5412 2023-10-31 05:53:56,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/86046bb665ac42aa91f041dba606d188_SeqId_47_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/86046bb665ac42aa91f041dba606d188_SeqId_47_ 2023-10-31 05:53:56,710 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-31 05:53:56,711 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-31 05:53:56,712 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-31 05:53:56,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-31 05:53:56,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, REOPEN/MOVE}] 2023-10-31 05:53:56,721 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, REOPEN/MOVE 2023-10-31 05:53:56,721 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=f0080370107a624806071940a49aebd1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:56,721 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731636721"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731636721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731636721"}]},"ts":"1698731636721"} 2023-10-31 05:53:56,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure f0080370107a624806071940a49aebd1, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:56,874 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:56,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close f0080370107a624806071940a49aebd1 2023-10-31 05:53:56,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f0080370107a624806071940a49aebd1, disabling compactions & flushes 2023-10-31 05:53:56,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:56,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:56,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. after waiting 0 ms 2023-10-31 05:53:56,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:56,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-31 05:53:56,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:56,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:56,887 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: f0080370107a624806071940a49aebd1 to self. 2023-10-31 05:53:56,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed f0080370107a624806071940a49aebd1 2023-10-31 05:53:56,890 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=f0080370107a624806071940a49aebd1, regionState=CLOSED 2023-10-31 05:53:56,890 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731636890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731636890"}]},"ts":"1698731636890"} 2023-10-31 05:53:56,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-10-31 05:53:56,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure f0080370107a624806071940a49aebd1, server=jenkins-hbase20.apache.org,43723,1698731565849 in 169 msec 2023-10-31 05:53:56,896 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=true 2023-10-31 05:53:57,047 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=f0080370107a624806071940a49aebd1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:57,047 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731637047"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731637047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731637047"}]},"ts":"1698731637047"} 2023-10-31 05:53:57,049 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure f0080370107a624806071940a49aebd1, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:57,201 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:57,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:57,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0080370107a624806071940a49aebd1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:53:57,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly f0080370107a624806071940a49aebd1 2023-10-31 05:53:57,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:57,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f0080370107a624806071940a49aebd1 2023-10-31 05:53:57,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f0080370107a624806071940a49aebd1 2023-10-31 05:53:57,205 INFO [StoreOpener-f0080370107a624806071940a49aebd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f0080370107a624806071940a49aebd1 2023-10-31 05:53:57,206 DEBUG [StoreOpener-f0080370107a624806071940a49aebd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:57,206 DEBUG [StoreOpener-f0080370107a624806071940a49aebd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:57,206 INFO [StoreOpener-f0080370107a624806071940a49aebd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0080370107a624806071940a49aebd1 columnFamilyName family1 2023-10-31 05:53:57,211 DEBUG [StoreOpener-f0080370107a624806071940a49aebd1-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/3ada3ecd4ce648c48fc215c3d0d764cf 2023-10-31 05:53:57,212 INFO [StoreOpener-f0080370107a624806071940a49aebd1-1] regionserver.HStore(310): Store=f0080370107a624806071940a49aebd1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:57,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1 2023-10-31 05:53:57,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1 2023-10-31 05:53:57,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f0080370107a624806071940a49aebd1 2023-10-31 05:53:57,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f0080370107a624806071940a49aebd1; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65135819, jitterRate=-0.02940066158771515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:53:57,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:57,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1., pid=47, masterSystemTime=1698731637200 2023-10-31 05:53:57,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:57,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:57,219 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=f0080370107a624806071940a49aebd1, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:57,220 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731637219"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731637219"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731637219"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731637219"}]},"ts":"1698731637219"} 2023-10-31 05:53:57,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-10-31 05:53:57,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure f0080370107a624806071940a49aebd1, server=jenkins-hbase20.apache.org,43723,1698731565849 in 172 msec 2023-10-31 05:53:57,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-31 05:53:57,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, REOPEN/MOVE in 503 msec 2023-10-31 05:53:57,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-10-31 05:53:57,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 509 msec 2023-10-31 05:53:57,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 931 msec 2023-10-31 05:53:57,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-10-31 05:53:57,229 INFO [Listener at localhost/40291] compactions.TestMobCompactor(278): alter status finished 2023-10-31 05:53:57,230 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:57,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:57,231 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:57,232 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:57,232 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732237232 2023-10-31 05:53:57,233 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:53:57,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-31 05:53:57,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:57,236 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x6a6ce160 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:53:57,240 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d4ad1fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:53:57,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:57,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:57,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:57,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:57,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,065 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112871e62092a1fe4d8ea48d0231b31fc1f4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112871e62092a1fe4d8ea48d0231b31fc1f4 2023-10-31 05:53:58,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:58,082 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:53:58,083 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:53:58,091 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:53:58,093 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:53:58,103 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/962058cc1f8d44a1b5a5827da99c5fdf first=Optional[r05] last=Optional[r8] 2023-10-31 05:53:58,104 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=51 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/962058cc1f8d44a1b5a5827da99c5fdf}] 2023-10-31 05:53:58,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/962058cc1f8d44a1b5a5827da99c5fdf for inclusion in f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:58,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-31 05:53:58,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:53:58,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:58,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/962058cc1f8d44a1b5a5827da99c5fdf to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c6ntjo2gsev1obpa0spnsoq1vhfa385hvrtni8rmlpgldcg0inj3tdjvlugrkdfo/family1/962058cc1f8d44a1b5a5827da99c5fdf 2023-10-31 05:53:58,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c6ntjo2gsev1obpa0spnsoq1vhfa385hvrtni8rmlpgldcg0inj3tdjvlugrkdfo/family1/962058cc1f8d44a1b5a5827da99c5fdf as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/4de7a67919da45da98ac040dd4ca1d8e_SeqId_53_ 2023-10-31 05:53:58,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c6ntjo2gsev1obpa0spnsoq1vhfa385hvrtni8rmlpgldcg0inj3tdjvlugrkdfo/family1/962058cc1f8d44a1b5a5827da99c5fdf into f0080370107a624806071940a49aebd1/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/4de7a67919da45da98ac040dd4ca1d8e_SeqId_53_ - updating store file list. 2023-10-31 05:53:58,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/4de7a67919da45da98ac040dd4ca1d8e_SeqId_53_ into f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:58,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c6ntjo2gsev1obpa0spnsoq1vhfa385hvrtni8rmlpgldcg0inj3tdjvlugrkdfo/family1/962058cc1f8d44a1b5a5827da99c5fdf into f0080370107a624806071940a49aebd1/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/4de7a67919da45da98ac040dd4ca1d8e_SeqId_53_) 2023-10-31 05:53:58,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c6ntjo2gsev1obpa0spnsoq1vhfa385hvrtni8rmlpgldcg0inj3tdjvlugrkdfo/family1/962058cc1f8d44a1b5a5827da99c5fdf 2023-10-31 05:53:58,128 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:58,129 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:53:58,130 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511202bfdc5bd30504a99bcb08a6a479e3a65 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511202bfdc5bd30504a99bcb08a6a479e3a65 2023-10-31 05:53:58,131 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d444a1fc449548899f82601f34eebd02 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d444a1fc449548899f82601f34eebd02 2023-10-31 05:53:58,131 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-10-31 05:53:58,131 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-31 05:53:58,132 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,132 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,132 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,132 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:58,132 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:58,133 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:58,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 903 msec 2023-10-31 05:53:58,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-31 05:53:58,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:58,202 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-31 05:53:58,203 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-31 05:53:58,203 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-31 05:53:58,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-31 05:53:58,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, REOPEN/MOVE}] 2023-10-31 05:53:58,209 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, REOPEN/MOVE 2023-10-31 05:53:58,209 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=f0080370107a624806071940a49aebd1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:58,209 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731638209"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731638209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731638209"}]},"ts":"1698731638209"} 2023-10-31 05:53:58,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure f0080370107a624806071940a49aebd1, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:58,362 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:58,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close f0080370107a624806071940a49aebd1 2023-10-31 05:53:58,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f0080370107a624806071940a49aebd1, disabling compactions & flushes 2023-10-31 05:53:58,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:58,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:58,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. after waiting 0 ms 2023-10-31 05:53:58,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:58,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-31 05:53:58,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:58,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:58,371 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: f0080370107a624806071940a49aebd1 to self. 2023-10-31 05:53:58,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed f0080370107a624806071940a49aebd1 2023-10-31 05:53:58,373 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=f0080370107a624806071940a49aebd1, regionState=CLOSED 2023-10-31 05:53:58,373 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731638373"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731638373"}]},"ts":"1698731638373"} 2023-10-31 05:53:58,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-31 05:53:58,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure f0080370107a624806071940a49aebd1, server=jenkins-hbase20.apache.org,43723,1698731565849 in 163 msec 2023-10-31 05:53:58,377 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=true 2023-10-31 05:53:58,527 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=f0080370107a624806071940a49aebd1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:58,527 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731638527"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731638527"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731638527"}]},"ts":"1698731638527"} 2023-10-31 05:53:58,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure f0080370107a624806071940a49aebd1, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:58,681 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:58,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:58,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0080370107a624806071940a49aebd1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:53:58,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly f0080370107a624806071940a49aebd1 2023-10-31 05:53:58,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:58,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f0080370107a624806071940a49aebd1 2023-10-31 05:53:58,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f0080370107a624806071940a49aebd1 2023-10-31 05:53:58,686 INFO [StoreOpener-f0080370107a624806071940a49aebd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f0080370107a624806071940a49aebd1 2023-10-31 05:53:58,687 DEBUG [StoreOpener-f0080370107a624806071940a49aebd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:58,687 DEBUG [StoreOpener-f0080370107a624806071940a49aebd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1 2023-10-31 05:53:58,687 INFO [StoreOpener-f0080370107a624806071940a49aebd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0080370107a624806071940a49aebd1 columnFamilyName family1 2023-10-31 05:53:58,692 DEBUG [StoreOpener-f0080370107a624806071940a49aebd1-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/3ada3ecd4ce648c48fc215c3d0d764cf 2023-10-31 05:53:58,696 DEBUG [StoreOpener-f0080370107a624806071940a49aebd1-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/family1/4de7a67919da45da98ac040dd4ca1d8e_SeqId_53_ 2023-10-31 05:53:58,696 INFO [StoreOpener-f0080370107a624806071940a49aebd1-1] regionserver.HStore(310): Store=f0080370107a624806071940a49aebd1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:58,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1 2023-10-31 05:53:58,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1 2023-10-31 05:53:58,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f0080370107a624806071940a49aebd1 2023-10-31 05:53:58,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f0080370107a624806071940a49aebd1; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64629140, jitterRate=-0.036950767040252686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:53:58,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:53:58,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1., pid=53, masterSystemTime=1698731638681 2023-10-31 05:53:58,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:58,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:53:58,703 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=f0080370107a624806071940a49aebd1, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:58,704 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698731638703"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731638703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731638703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731638703"}]},"ts":"1698731638703"} 2023-10-31 05:53:58,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-31 05:53:58,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure f0080370107a624806071940a49aebd1, server=jenkins-hbase20.apache.org,43723,1698731565849 in 176 msec 2023-10-31 05:53:58,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-10-31 05:53:58,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=f0080370107a624806071940a49aebd1, REOPEN/MOVE in 498 msec 2023-10-31 05:53:58,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-10-31 05:53:58,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 503 msec 2023-10-31 05:53:58,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 524 msec 2023-10-31 05:53:58,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-10-31 05:53:58,713 INFO [Listener at localhost/40291] compactions.TestMobCompactor(278): alter status finished 2023-10-31 05:53:58,714 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-31 05:53:58,715 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:58,716 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:58,717 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:58,717 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732238717 2023-10-31 05:53:58,718 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:53:58,719 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-31 05:53:58,719 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:58,720 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x708ad360 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:53:58,724 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b14198a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:53:58,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,725 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,725 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,725 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-31 05:53:58,725 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-31 05:53:58,725 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:53:58,726 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-31 05:53:58,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-10-31 05:53:58,782 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=248 (was 256), OpenFileDescriptor=616 (was 617), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 190) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1338 (was 1691) 2023-10-31 05:53:58,796 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=248, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=216, ProcessCount=169, AvailableMemoryMB=1337 2023-10-31 05:53:58,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-31 05:53:58,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:53:58,800 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:53:58,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-10-31 05:53:58,801 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:53:58,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-31 05:53:58,803 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:53:58,803 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf empty. 2023-10-31 05:53:58,804 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:53:58,804 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-10-31 05:53:58,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-31 05:53:59,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-31 05:53:59,213 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-31 05:53:59,214 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 405bdcc0cafe6c5fe7e0825a7b7c50cf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:53:59,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-31 05:53:59,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:59,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 405bdcc0cafe6c5fe7e0825a7b7c50cf, disabling compactions & flushes 2023-10-31 05:53:59,620 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:53:59,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:53:59,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. after waiting 0 ms 2023-10-31 05:53:59,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:53:59,620 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:53:59,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:53:59,623 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:53:59,623 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731639623"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731639623"}]},"ts":"1698731639623"} 2023-10-31 05:53:59,625 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-31 05:53:59,625 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:53:59,626 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731639626"}]},"ts":"1698731639626"} 2023-10-31 05:53:59,627 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-10-31 05:53:59,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, ASSIGN}] 2023-10-31 05:53:59,631 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, ASSIGN 2023-10-31 05:53:59,632 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:53:59,783 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=405bdcc0cafe6c5fe7e0825a7b7c50cf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:59,783 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731639783"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731639783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731639783"}]},"ts":"1698731639783"} 2023-10-31 05:53:59,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 405bdcc0cafe6c5fe7e0825a7b7c50cf, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:53:59,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-31 05:53:59,938 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:59,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:53:59,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 405bdcc0cafe6c5fe7e0825a7b7c50cf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:53:59,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:53:59,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:53:59,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:53:59,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:53:59,943 INFO [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:53:59,945 DEBUG [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:53:59,945 DEBUG [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:53:59,946 INFO [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 405bdcc0cafe6c5fe7e0825a7b7c50cf columnFamilyName family1 2023-10-31 05:53:59,947 INFO [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] regionserver.HStore(310): Store=405bdcc0cafe6c5fe7e0825a7b7c50cf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:53:59,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:53:59,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:53:59,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:53:59,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:53:59,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 405bdcc0cafe6c5fe7e0825a7b7c50cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66184523, jitterRate=-0.013773754239082336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:53:59,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:53:59,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf., pid=57, masterSystemTime=1698731639938 2023-10-31 05:53:59,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:53:59,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:53:59,957 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=405bdcc0cafe6c5fe7e0825a7b7c50cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:53:59,957 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731639957"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731639957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731639957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731639957"}]},"ts":"1698731639957"} 2023-10-31 05:53:59,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-10-31 05:53:59,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 405bdcc0cafe6c5fe7e0825a7b7c50cf, server=jenkins-hbase20.apache.org,43723,1698731565849 in 173 msec 2023-10-31 05:53:59,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-10-31 05:53:59,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, ASSIGN in 331 msec 2023-10-31 05:53:59,963 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:53:59,963 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731639963"}]},"ts":"1698731639963"} 2023-10-31 05:53:59,964 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-10-31 05:53:59,966 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:53:59,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1680 sec 2023-10-31 05:54:00,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-31 05:54:00,909 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-10-31 05:54:00,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:00,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:00,936 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:00,936 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:00,936 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-31 05:54:00,936 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-31 05:54:00,936 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:00,936 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:00,937 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:00,937 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:00,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:00,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:00,937 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:00,937 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:00,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:00,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:00,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:00,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:00,938 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:00,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:00,938 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-31 05:54:00,938 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:00,938 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-31 05:54:00,940 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:54:00,940 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:00,940 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:00,940 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. started... 2023-10-31 05:54:00,941 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 405bdcc0cafe6c5fe7e0825a7b7c50cf 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-31 05:54:01,371 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113038826c00440e434a836b727a46298953 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113038826c00440e434a836b727a46298953 2023-10-31 05:54:01,776 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/5361b2c8e0ff4d5aa66ea5da0aa3be08 2023-10-31 05:54:01,788 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/5361b2c8e0ff4d5aa66ea5da0aa3be08 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5361b2c8e0ff4d5aa66ea5da0aa3be08 2023-10-31 05:54:01,792 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5361b2c8e0ff4d5aa66ea5da0aa3be08, entries=1000, sequenceid=5, filesize=190.5 K 2023-10-31 05:54:01,793 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 405bdcc0cafe6c5fe7e0825a7b7c50cf in 852ms, sequenceid=5, compaction requested=false 2023-10-31 05:54:01,793 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:01,794 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:01,794 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:01,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:54:01,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:54:01,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-31 05:54:01,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-31 05:54:01,795 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,795 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:01,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:01,796 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,796 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:01,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:01,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:01,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:01,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-31 05:54:01,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4700dfda[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:01,797 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-31 05:54:01,797 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,797 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,798 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-31 05:54:01,798 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-31 05:54:01,798 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:01,798 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,798 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:01,798 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,798 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-31 05:54:01,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:01,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:01,798 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:01,799 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-31 05:54:01,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:01,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:01,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:01,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:01,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-31 05:54:01,800 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-31 05:54:01,800 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:01,801 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:01,801 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,801 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:01,802 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,802 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:01,802 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:01,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:01,802 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,803 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:01,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,807 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:01,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:01,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:01,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:01,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:01,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:01,807 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:01,907 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:01,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:01,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:01,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:01,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,914 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:01,914 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:01,914 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-31 05:54:01,914 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-31 05:54:01,915 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,915 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,916 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,916 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:01,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:01,916 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:01,916 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,916 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,917 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-31 05:54:01,917 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:01,917 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-31 05:54:01,917 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:01,917 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-31 05:54:01,917 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:54:01,917 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:01,917 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:01,917 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. started... 2023-10-31 05:54:01,917 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 405bdcc0cafe6c5fe7e0825a7b7c50cf 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-31 05:54:02,338 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286e49aef125e64cd2ac89ea910bc7f5d9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286e49aef125e64cd2ac89ea910bc7f5d9 2023-10-31 05:54:02,417 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:54:02,746 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/5c0ded7243b34825a718dbd70b801881 2023-10-31 05:54:02,755 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/5c0ded7243b34825a718dbd70b801881 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5c0ded7243b34825a718dbd70b801881 2023-10-31 05:54:02,763 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5c0ded7243b34825a718dbd70b801881, entries=1, sequenceid=9, filesize=5.0 K 2023-10-31 05:54:02,764 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 405bdcc0cafe6c5fe7e0825a7b7c50cf in 847ms, sequenceid=9, compaction requested=false 2023-10-31 05:54:02,764 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:02,764 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:02,764 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:54:02,764 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:54:02,764 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,764 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-31 05:54:02,764 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-31 05:54:02,766 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,766 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:02,766 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,766 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:02,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-31 05:54:02,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46c10964[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:02,768 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-31 05:54:02,768 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,769 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,769 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-31 05:54:02,770 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-31 05:54:02,770 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:02,770 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,770 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:02,771 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-31 05:54:02,771 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:02,771 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,771 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-31 05:54:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:02,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-31 05:54:02,776 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-31 05:54:02,776 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:02,776 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:02,776 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,776 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:02,778 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,778 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:02,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,778 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:02,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:02,779 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,780 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,783 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,783 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:02,783 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:02,783 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,783 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:02,783 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:02,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:02,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:02,784 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,784 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,784 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:02,784 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:02,784 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:02,784 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,885 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:02,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:02,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:02,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:02,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,900 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:02,900 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:02,900 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-31 05:54:02,900 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-31 05:54:02,901 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,901 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,902 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,902 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:02,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:02,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:02,902 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:02,902 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:02,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,904 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,904 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-31 05:54:02,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:02,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-31 05:54:02,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:02,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-31 05:54:02,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:54:02,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:02,904 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:02,904 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. started... 2023-10-31 05:54:02,904 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 405bdcc0cafe6c5fe7e0825a7b7c50cf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:54:02,918 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120159c006868cdf42bfb36320358d97ca00 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120159c006868cdf42bfb36320358d97ca00 2023-10-31 05:54:03,324 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/3125c8da3f5a40aaae0c6ec64c7be691 2023-10-31 05:54:03,338 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/3125c8da3f5a40aaae0c6ec64c7be691 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/3125c8da3f5a40aaae0c6ec64c7be691 2023-10-31 05:54:03,345 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/3125c8da3f5a40aaae0c6ec64c7be691, entries=1, sequenceid=13, filesize=5.0 K 2023-10-31 05:54:03,346 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 405bdcc0cafe6c5fe7e0825a7b7c50cf in 442ms, sequenceid=13, compaction requested=true 2023-10-31 05:54:03,346 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:03,346 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:03,347 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:54:03,347 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:54:03,347 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,347 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-31 05:54:03,347 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-31 05:54:03,348 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,348 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:03,348 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,348 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:03,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-31 05:54:03,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51702c5e[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:03,349 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-31 05:54:03,349 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,350 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,350 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-31 05:54:03,350 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-31 05:54:03,350 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:03,350 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,350 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:03,351 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,351 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-31 05:54:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:03,351 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:03,351 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-31 05:54:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:03,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:03,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:03,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:03,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-31 05:54:03,353 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-31 05:54:03,353 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:03,353 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:03,353 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,353 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:03,354 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,354 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,354 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:03,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:03,355 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,355 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:03,357 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:03,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-31 05:54:03,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:03,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:03,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:03,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:03,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:03,357 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:03,457 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:03,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:03,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:03,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:03,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,470 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:03,470 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:03,470 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-31 05:54:03,470 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-31 05:54:03,471 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,471 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,473 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:03,473 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:03,474 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:03,474 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,476 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,476 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-31 05:54:03,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:03,477 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-31 05:54:03,477 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:03,477 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-31 05:54:03,477 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:54:03,477 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:03,477 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:03,477 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. started... 2023-10-31 05:54:03,477 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 405bdcc0cafe6c5fe7e0825a7b7c50cf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:54:03,904 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205970bee98708a42368bc8441014734408 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205970bee98708a42368bc8441014734408 2023-10-31 05:54:04,310 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/ec992add206e4d269e7871b8509b48ec 2023-10-31 05:54:04,321 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/ec992add206e4d269e7871b8509b48ec as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/ec992add206e4d269e7871b8509b48ec 2023-10-31 05:54:04,326 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/ec992add206e4d269e7871b8509b48ec, entries=1, sequenceid=17, filesize=5.0 K 2023-10-31 05:54:04,326 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 405bdcc0cafe6c5fe7e0825a7b7c50cf in 849ms, sequenceid=17, compaction requested=true 2023-10-31 05:54:04,327 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:04,327 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:04,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:54:04,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:54:04,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-31 05:54:04,327 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-31 05:54:04,330 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,330 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:04,330 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:04,330 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:04,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-31 05:54:04,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@520a09f[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:04,331 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-31 05:54:04,332 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,340 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,341 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-31 05:54:04,341 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-31 05:54:04,341 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:04,341 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,341 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:04,354 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-31 05:54:04,354 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,354 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:04,354 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-31 05:54:04,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:04,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:04,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:04,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-31 05:54:04,357 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-31 05:54:04,357 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:04,357 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:04,357 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,357 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:04,359 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,359 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:04,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,359 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:04,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:04,359 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,360 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:04,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,362 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,362 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,362 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,362 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,362 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,362 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:04,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:04,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-31 05:54:04,362 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,362 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:04,362 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:04,363 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:04,366 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:04,366 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:04,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:04,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:04,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:04,463 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:04,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:04,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:04,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:04,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,470 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:04,470 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:04,470 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-31 05:54:04,470 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-31 05:54:04,471 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,471 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,471 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:04,472 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:04,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:04,472 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:04,472 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:04,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:04,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,473 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,473 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-31 05:54:04,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:04,473 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-31 05:54:04,473 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:04,473 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-31 05:54:04,473 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:54:04,474 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:04,474 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:04,474 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. started... 2023-10-31 05:54:04,474 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 405bdcc0cafe6c5fe7e0825a7b7c50cf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:54:04,898 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122847ac99d952114743bd3c7e303d8a6bbb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122847ac99d952114743bd3c7e303d8a6bbb 2023-10-31 05:54:05,305 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/e0594e1d5e41491b855b119a3dc3eb3f 2023-10-31 05:54:05,316 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/e0594e1d5e41491b855b119a3dc3eb3f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/e0594e1d5e41491b855b119a3dc3eb3f 2023-10-31 05:54:05,322 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/e0594e1d5e41491b855b119a3dc3eb3f, entries=1, sequenceid=21, filesize=5.0 K 2023-10-31 05:54:05,323 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 405bdcc0cafe6c5fe7e0825a7b7c50cf in 849ms, sequenceid=21, compaction requested=true 2023-10-31 05:54:05,323 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:05,324 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:05,324 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:54:05,324 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:54:05,324 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,324 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-31 05:54:05,324 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-31 05:54:05,325 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,325 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:05,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:05,326 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,326 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:05,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:05,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:05,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:05,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-31 05:54:05,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@449f51ee[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:05,328 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-31 05:54:05,328 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,329 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,329 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-31 05:54:05,329 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-31 05:54:05,329 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:05,329 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,329 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-31 05:54:05,330 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:05,330 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-31 05:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-31 05:54:05,334 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-31 05:54:05,334 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:05,334 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:05,334 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,334 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:05,335 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,335 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:05,335 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:05,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:05,335 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,336 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,337 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,337 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,337 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:05,337 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:05,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:05,337 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:05,337 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:05,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-31 05:54:05,337 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:05,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:05,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:05,337 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:05,338 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,338 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,338 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:05,338 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:05,438 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:05,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:05,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:05,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:05,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,447 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:05,447 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:05,447 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-31 05:54:05,447 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-31 05:54:05,448 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,448 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,449 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:05,449 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:05,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:05,450 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:05,450 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:05,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:05,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,452 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,453 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-31 05:54:05,453 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:05,453 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-31 05:54:05,453 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:05,453 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-31 05:54:05,453 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:54:05,453 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:05,454 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:05,454 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. started... 2023-10-31 05:54:05,454 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 405bdcc0cafe6c5fe7e0825a7b7c50cf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:54:05,878 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d8b0313926914aabbb4b76ac0a4532e5 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231d8b0313926914aabbb4b76ac0a4532e5 2023-10-31 05:54:06,287 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/7a559bf44f3c4b319f6812631fc8f994 2023-10-31 05:54:06,299 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/7a559bf44f3c4b319f6812631fc8f994 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/7a559bf44f3c4b319f6812631fc8f994 2023-10-31 05:54:06,304 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/7a559bf44f3c4b319f6812631fc8f994, entries=1, sequenceid=25, filesize=5.0 K 2023-10-31 05:54:06,305 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 405bdcc0cafe6c5fe7e0825a7b7c50cf in 851ms, sequenceid=25, compaction requested=true 2023-10-31 05:54:06,305 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:06,305 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:06,305 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:54:06,305 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:54:06,305 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,305 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-31 05:54:06,305 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-31 05:54:06,307 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,307 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:06,307 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,307 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:06,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-31 05:54:06,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a5bfa30[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:06,309 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-31 05:54:06,309 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,309 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,309 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-31 05:54:06,309 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-31 05:54:06,309 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:06,310 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,310 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:06,310 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-31 05:54:06,310 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,310 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:06,310 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-31 05:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:06,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:06,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-31 05:54:06,313 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-31 05:54:06,313 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:06,313 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:06,313 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,313 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:06,315 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,315 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:06,315 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:06,315 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:06,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:06,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,316 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:06,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,318 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,318 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:06,318 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:06,318 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,319 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:06,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-31 05:54:06,318 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:06,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:06,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:06,319 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,319 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:06,319 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,319 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,319 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:06,319 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:06,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:06,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:06,419 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:06,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:06,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:06,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:06,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,434 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:06,434 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:06,434 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-31 05:54:06,434 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-31 05:54:06,435 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,435 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,436 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,436 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:06,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:06,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:06,437 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:06,437 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:06,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,438 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,439 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-31 05:54:06,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:06,439 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-31 05:54:06,439 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:06,439 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-31 05:54:06,439 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:54:06,439 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:06,439 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:06,440 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. started... 2023-10-31 05:54:06,440 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 405bdcc0cafe6c5fe7e0825a7b7c50cf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:54:06,863 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010c3d0162b31d4bf0a4346ea4b70b5e65 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010c3d0162b31d4bf0a4346ea4b70b5e65 2023-10-31 05:54:07,270 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/83ce302ea9614140a551dc5b49658e5a 2023-10-31 05:54:07,284 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/83ce302ea9614140a551dc5b49658e5a as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/83ce302ea9614140a551dc5b49658e5a 2023-10-31 05:54:07,290 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/83ce302ea9614140a551dc5b49658e5a, entries=1, sequenceid=29, filesize=5.0 K 2023-10-31 05:54:07,290 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 405bdcc0cafe6c5fe7e0825a7b7c50cf in 850ms, sequenceid=29, compaction requested=true 2023-10-31 05:54:07,291 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:07,291 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:07,291 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:54:07,291 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:54:07,291 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,291 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-31 05:54:07,291 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-31 05:54:07,292 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,292 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:07,293 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,293 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:07,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-31 05:54:07,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a9935f9[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:07,294 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-31 05:54:07,294 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,295 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,295 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-31 05:54:07,295 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-31 05:54:07,295 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:07,295 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,295 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:07,296 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-31 05:54:07,296 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:07,296 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,296 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-31 05:54:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:07,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-31 05:54:07,297 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-31 05:54:07,298 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:07,298 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:07,298 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,298 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:07,298 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,298 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:07,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,298 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:07,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:07,299 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,300 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,301 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,301 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,301 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:07,301 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,301 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:07,301 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:07,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:07,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:07,301 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:07,301 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,302 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,302 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:07,302 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:07,302 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:07,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:07,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:07,402 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:07,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:07,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:07,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:07,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,410 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:07,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:07,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-31 05:54:07,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-31 05:54:07,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,411 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:07,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:07,412 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:07,412 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:07,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:07,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,413 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,413 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-31 05:54:07,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:07,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-31 05:54:07,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:07,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-31 05:54:07,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:54:07,414 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:07,414 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:07,414 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. started... 2023-10-31 05:54:07,414 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 405bdcc0cafe6c5fe7e0825a7b7c50cf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:54:07,834 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031f59e0fdfd1a46928934ba769d35832e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601031f59e0fdfd1a46928934ba769d35832e 2023-10-31 05:54:08,241 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/40cef667ee8b4ed3ba47b1c1419d0fc5 2023-10-31 05:54:08,252 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/40cef667ee8b4ed3ba47b1c1419d0fc5 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/40cef667ee8b4ed3ba47b1c1419d0fc5 2023-10-31 05:54:08,258 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/40cef667ee8b4ed3ba47b1c1419d0fc5, entries=1, sequenceid=33, filesize=5.0 K 2023-10-31 05:54:08,259 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 405bdcc0cafe6c5fe7e0825a7b7c50cf in 845ms, sequenceid=33, compaction requested=true 2023-10-31 05:54:08,260 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:08,260 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:08,260 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:54:08,260 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:54:08,260 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,260 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-31 05:54:08,260 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-31 05:54:08,262 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,262 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:08,262 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,262 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:08,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:08,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:08,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-31 05:54:08,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5abd526d[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:08,264 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-31 05:54:08,264 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,265 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,265 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-31 05:54:08,265 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-31 05:54:08,265 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,265 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:08,265 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:08,266 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-31 05:54:08,266 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:08,266 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,267 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-31 05:54:08,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:08,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:08,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:08,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:08,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:08,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:08,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-31 05:54:08,269 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-31 05:54:08,269 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:08,269 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:08,269 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,269 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:08,271 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,271 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,271 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:08,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:08,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:08,271 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:08,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:08,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,272 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:08,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:08,274 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:08,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:08,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:08,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:08,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:08,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:08,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:08,274 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:08,375 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:08,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:08,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:08,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:08,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,385 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:08,385 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:08,385 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-31 05:54:08,385 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-31 05:54:08,386 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,386 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,387 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:08,387 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:08,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:08,387 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:08,387 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:08,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:08,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,388 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,388 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-31 05:54:08,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:08,388 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-31 05:54:08,388 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:08,388 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-31 05:54:08,388 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:54:08,388 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:08,388 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:08,388 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. started... 2023-10-31 05:54:08,388 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 405bdcc0cafe6c5fe7e0825a7b7c50cf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:54:08,808 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907bbcb65ca664c4c75bacbf0acc8eb7e1b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907bbcb65ca664c4c75bacbf0acc8eb7e1b 2023-10-31 05:54:09,216 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/dc9d305c39244ecebeb9da394553df52 2023-10-31 05:54:09,222 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/dc9d305c39244ecebeb9da394553df52 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/dc9d305c39244ecebeb9da394553df52 2023-10-31 05:54:09,228 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/dc9d305c39244ecebeb9da394553df52, entries=1, sequenceid=37, filesize=5.0 K 2023-10-31 05:54:09,229 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 405bdcc0cafe6c5fe7e0825a7b7c50cf in 841ms, sequenceid=37, compaction requested=true 2023-10-31 05:54:09,229 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:09,229 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:09,230 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:54:09,230 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:54:09,230 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,230 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-31 05:54:09,230 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-31 05:54:09,231 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,231 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:09,232 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,232 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:09,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-31 05:54:09,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@641378f5[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:09,234 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-31 05:54:09,235 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,235 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,236 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-31 05:54:09,236 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-31 05:54:09,236 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:09,236 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,236 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:09,237 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-31 05:54:09,237 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:09,237 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,237 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-31 05:54:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:09,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-31 05:54:09,242 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-31 05:54:09,242 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:09,242 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:09,242 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,242 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:09,244 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,244 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:09,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,244 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:09,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:09,244 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:09,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:09,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,246 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:09,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,249 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,249 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,249 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:09,249 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,249 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:09,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-31 05:54:09,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:09,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:09,249 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:09,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:09,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:09,249 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,250 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,250 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:09,250 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:09,250 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:09,250 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:09,350 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:09,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:09,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:09,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:09,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,366 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:09,367 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:09,367 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-31 05:54:09,367 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-31 05:54:09,368 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,368 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,369 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:09,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:09,370 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,370 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:09,371 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:09,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:09,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,372 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,373 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-31 05:54:09,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:09,373 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-31 05:54:09,373 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:09,373 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-31 05:54:09,374 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:54:09,374 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:09,374 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:09,374 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. started... 2023-10-31 05:54:09,374 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 405bdcc0cafe6c5fe7e0825a7b7c50cf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:54:09,804 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c7962c8db0e847ecb8db0d9e01c54700 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120c7962c8db0e847ecb8db0d9e01c54700 2023-10-31 05:54:10,212 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/07ad5747e195478c9ab7ecb4ee015e82 2023-10-31 05:54:10,216 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/07ad5747e195478c9ab7ecb4ee015e82 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/07ad5747e195478c9ab7ecb4ee015e82 2023-10-31 05:54:10,220 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/07ad5747e195478c9ab7ecb4ee015e82, entries=1, sequenceid=41, filesize=5.0 K 2023-10-31 05:54:10,221 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 405bdcc0cafe6c5fe7e0825a7b7c50cf in 847ms, sequenceid=41, compaction requested=true 2023-10-31 05:54:10,221 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:10,221 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:10,221 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:54:10,221 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:54:10,221 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,222 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-31 05:54:10,222 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-31 05:54:10,223 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,223 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:10,223 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,223 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:10,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-31 05:54:10,224 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-31 05:54:10,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314c843d[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:10,224 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,225 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,225 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,225 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:10,225 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-31 05:54:10,225 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-31 05:54:10,225 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:10,225 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-31 05:54:10,225 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,226 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:10,226 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-31 05:54:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:10,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-31 05:54:10,228 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-31 05:54:10,228 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:10,228 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:10,228 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,228 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:10,228 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,228 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:10,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,228 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:10,229 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,230 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,231 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,231 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,231 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,231 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:10,231 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:10,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:10,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-31 05:54:10,231 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:10,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-31 05:54:10,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:10,231 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:10,231 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,232 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,232 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,232 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:10,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:10,232 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:10,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:10,332 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:10,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:10,334 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:10,337 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-31 05:54:10,338 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-31 05:54:10,339 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732250339 2023-10-31 05:54:10,339 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:54:10,343 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:54:10,344 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-31 05:54:10,345 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:10,347 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x3a769b34 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:54:10,351 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75293241, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:54:10,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:10,806 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103405533b2618f453fbcdf476d4612253a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103405533b2618f453fbcdf476d4612253a 2023-10-31 05:54:10,807 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:10,819 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:54:10,820 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:54:10,828 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:54:10,829 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:54:10,838 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dae4aa8fcd57475b9336b822151e07d1 first=Optional[r3] last=Optional[r6] 2023-10-31 05:54:10,839 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dae4aa8fcd57475b9336b822151e07d1}] 2023-10-31 05:54:10,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dae4aa8fcd57475b9336b822151e07d1 for inclusion in 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:54:10,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-31 05:54:10,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:54:10,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:10,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/dae4aa8fcd57475b9336b822151e07d1 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1h7lg0q9e2ho95t7ccrper9fhpcog68v498qdiistc4pav40an3kn36ghv5oher8/family1/dae4aa8fcd57475b9336b822151e07d1 2023-10-31 05:54:10,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1h7lg0q9e2ho95t7ccrper9fhpcog68v498qdiistc4pav40an3kn36ghv5oher8/family1/dae4aa8fcd57475b9336b822151e07d1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/29bac7162ee54797892449c29a4d76da_SeqId_44_ 2023-10-31 05:54:10,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1h7lg0q9e2ho95t7ccrper9fhpcog68v498qdiistc4pav40an3kn36ghv5oher8/family1/dae4aa8fcd57475b9336b822151e07d1 into 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/29bac7162ee54797892449c29a4d76da_SeqId_44_ - updating store file list. 2023-10-31 05:54:10,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/29bac7162ee54797892449c29a4d76da_SeqId_44_ into 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:54:10,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1h7lg0q9e2ho95t7ccrper9fhpcog68v498qdiistc4pav40an3kn36ghv5oher8/family1/dae4aa8fcd57475b9336b822151e07d1 into 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/29bac7162ee54797892449c29a4d76da_SeqId_44_) 2023-10-31 05:54:10,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1h7lg0q9e2ho95t7ccrper9fhpcog68v498qdiistc4pav40an3kn36ghv5oher8/family1/dae4aa8fcd57475b9336b822151e07d1 2023-10-31 05:54:10,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-31 05:54:10,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-31 05:54:10,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 is initiating minor compaction 2023-10-31 05:54:10,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@78a1c79b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:54:10,855 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:10,855 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5c0ded7243b34825a718dbd70b801881, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/3125c8da3f5a40aaae0c6ec64c7be691, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/ec992add206e4d269e7871b8509b48ec, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/e0594e1d5e41491b855b119a3dc3eb3f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/7a559bf44f3c4b319f6812631fc8f994, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/83ce302ea9614140a551dc5b49658e5a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/40cef667ee8b4ed3ba47b1c1419d0fc5, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/dc9d305c39244ecebeb9da394553df52, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/07ad5747e195478c9ab7ecb4ee015e82, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/29bac7162ee54797892449c29a4d76da_SeqId_44_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp, totalSize=50.3 K 2023-10-31 05:54:10,856 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 5c0ded7243b34825a718dbd70b801881, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-31 05:54:10,856 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 3125c8da3f5a40aaae0c6ec64c7be691, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-31 05:54:10,856 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting ec992add206e4d269e7871b8509b48ec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-31 05:54:10,856 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting e0594e1d5e41491b855b119a3dc3eb3f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-31 05:54:10,856 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 7a559bf44f3c4b319f6812631fc8f994, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-31 05:54:10,856 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 83ce302ea9614140a551dc5b49658e5a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-31 05:54:10,856 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 40cef667ee8b4ed3ba47b1c1419d0fc5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-31 05:54:10,856 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting dc9d305c39244ecebeb9da394553df52, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-31 05:54:10,856 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 07ad5747e195478c9ab7ecb4ee015e82, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-31 05:54:10,856 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 29bac7162ee54797892449c29a4d76da_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-31 05:54:10,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:10,857 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:10,859 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122847ac99d952114743bd3c7e303d8a6bbb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015122847ac99d952114743bd3c7e303d8a6bbb 2023-10-31 05:54:10,860 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231d8b0313926914aabbb4b76ac0a4532e5 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231d8b0313926914aabbb4b76ac0a4532e5 2023-10-31 05:54:10,860 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010c3d0162b31d4bf0a4346ea4b70b5e65 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010c3d0162b31d4bf0a4346ea4b70b5e65 2023-10-31 05:54:10,861 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601031f59e0fdfd1a46928934ba769d35832e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601031f59e0fdfd1a46928934ba769d35832e 2023-10-31 05:54:10,862 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-10-31 05:54:10,862 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-31 05:54:10,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:10,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:10,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:10,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:10,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:10,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:10,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:10,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:10,892 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): 405bdcc0cafe6c5fe7e0825a7b7c50cf#family1#compaction#72 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:11,716 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/1a49c1e6cc214c9797d0d1baec178bb3 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/1a49c1e6cc214c9797d0d1baec178bb3 2023-10-31 05:54:11,721 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120537acc94d7f0c4432ad2729f2744c09f4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120537acc94d7f0c4432ad2729f2744c09f4 2023-10-31 05:54:11,722 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 of 405bdcc0cafe6c5fe7e0825a7b7c50cf into 1a49c1e6cc214c9797d0d1baec178bb3(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:54:11,722 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:11,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:11,722 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698731650855; duration=0sec 2023-10-31 05:54:11,722 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:54:11,747 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a736916a4a640069833cd7cd38002ad first=Optional[r00] last=Optional[r2] 2023-10-31 05:54:11,748 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a736916a4a640069833cd7cd38002ad}] 2023-10-31 05:54:11,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a736916a4a640069833cd7cd38002ad for inclusion in 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:54:11,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-31 05:54:11,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:54:11,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:11,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a736916a4a640069833cd7cd38002ad to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1ok6f9brhgn5bobh8hp0s0p9i1vd2tsstm0amhg3jlmc3nom70lmn1ippednb7dl/family1/3a736916a4a640069833cd7cd38002ad 2023-10-31 05:54:11,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1ok6f9brhgn5bobh8hp0s0p9i1vd2tsstm0amhg3jlmc3nom70lmn1ippednb7dl/family1/3a736916a4a640069833cd7cd38002ad as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/de43eb2a03e1414ba5b4f82fb5658d07_SeqId_47_ 2023-10-31 05:54:11,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1ok6f9brhgn5bobh8hp0s0p9i1vd2tsstm0amhg3jlmc3nom70lmn1ippednb7dl/family1/3a736916a4a640069833cd7cd38002ad into 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/de43eb2a03e1414ba5b4f82fb5658d07_SeqId_47_ - updating store file list. 2023-10-31 05:54:11,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/de43eb2a03e1414ba5b4f82fb5658d07_SeqId_47_ into 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:54:11,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1ok6f9brhgn5bobh8hp0s0p9i1vd2tsstm0amhg3jlmc3nom70lmn1ippednb7dl/family1/3a736916a4a640069833cd7cd38002ad into 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/de43eb2a03e1414ba5b4f82fb5658d07_SeqId_47_) 2023-10-31 05:54:11,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1ok6f9brhgn5bobh8hp0s0p9i1vd2tsstm0amhg3jlmc3nom70lmn1ippednb7dl/family1/3a736916a4a640069833cd7cd38002ad 2023-10-31 05:54:11,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-31 05:54:11,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-31 05:54:11,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 is initiating minor compaction (all files) 2023-10-31 05:54:11,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@69879e64; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:54:11,763 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:11,763 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5361b2c8e0ff4d5aa66ea5da0aa3be08, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/1a49c1e6cc214c9797d0d1baec178bb3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/de43eb2a03e1414ba5b4f82fb5658d07_SeqId_47_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp, totalSize=388.1 K 2023-10-31 05:54:11,763 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting 5361b2c8e0ff4d5aa66ea5da0aa3be08, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878848969 2023-10-31 05:54:11,764 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting 1a49c1e6cc214c9797d0d1baec178bb3, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621248969 2023-10-31 05:54:11,764 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting de43eb2a03e1414ba5b4f82fb5658d07_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878848969 2023-10-31 05:54:11,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:11,765 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:11,766 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113038826c00440e434a836b727a46298953 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113038826c00440e434a836b727a46298953 2023-10-31 05:54:11,767 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120159c006868cdf42bfb36320358d97ca00 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120159c006868cdf42bfb36320358d97ca00 2023-10-31 05:54:11,768 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205970bee98708a42368bc8441014734408 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205970bee98708a42368bc8441014734408 2023-10-31 05:54:11,768 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-10-31 05:54:11,768 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-31 05:54:11,769 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:11,769 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:11,769 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:54:11,770 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-31 05:54:11,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4350 sec 2023-10-31 05:54:11,780 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] throttle.PressureAwareThroughputController(145): 405bdcc0cafe6c5fe7e0825a7b7c50cf#family1#compaction#73 average throughput is 19.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:11,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5c0ded7243b34825a718dbd70b801881, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/3125c8da3f5a40aaae0c6ec64c7be691, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/ec992add206e4d269e7871b8509b48ec, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/e0594e1d5e41491b855b119a3dc3eb3f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/7a559bf44f3c4b319f6812631fc8f994, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/83ce302ea9614140a551dc5b49658e5a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/40cef667ee8b4ed3ba47b1c1419d0fc5, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/dc9d305c39244ecebeb9da394553df52, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/07ad5747e195478c9ab7ecb4ee015e82, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/29bac7162ee54797892449c29a4d76da_SeqId_44_] to archive 2023-10-31 05:54:11,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:11,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5c0ded7243b34825a718dbd70b801881 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5c0ded7243b34825a718dbd70b801881 2023-10-31 05:54:11,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/3125c8da3f5a40aaae0c6ec64c7be691 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/3125c8da3f5a40aaae0c6ec64c7be691 2023-10-31 05:54:11,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/ec992add206e4d269e7871b8509b48ec to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/ec992add206e4d269e7871b8509b48ec 2023-10-31 05:54:11,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/e0594e1d5e41491b855b119a3dc3eb3f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/e0594e1d5e41491b855b119a3dc3eb3f 2023-10-31 05:54:11,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/7a559bf44f3c4b319f6812631fc8f994 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/7a559bf44f3c4b319f6812631fc8f994 2023-10-31 05:54:11,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/83ce302ea9614140a551dc5b49658e5a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/83ce302ea9614140a551dc5b49658e5a 2023-10-31 05:54:11,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/40cef667ee8b4ed3ba47b1c1419d0fc5 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/40cef667ee8b4ed3ba47b1c1419d0fc5 2023-10-31 05:54:11,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/dc9d305c39244ecebeb9da394553df52 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/dc9d305c39244ecebeb9da394553df52 2023-10-31 05:54:11,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/07ad5747e195478c9ab7ecb4ee015e82 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/07ad5747e195478c9ab7ecb4ee015e82 2023-10-31 05:54:11,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/29bac7162ee54797892449c29a4d76da_SeqId_44_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/29bac7162ee54797892449c29a4d76da_SeqId_44_ 2023-10-31 05:54:11,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-31 05:54:11,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:12,256 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-31 05:54:12,257 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-31 05:54:12,257 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-31 05:54:12,259 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-31 05:54:12,261 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, REOPEN/MOVE}] 2023-10-31 05:54:12,262 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, REOPEN/MOVE 2023-10-31 05:54:12,262 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=405bdcc0cafe6c5fe7e0825a7b7c50cf, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:12,262 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731652262"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731652262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731652262"}]},"ts":"1698731652262"} 2023-10-31 05:54:12,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 405bdcc0cafe6c5fe7e0825a7b7c50cf, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:12,415 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:12,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:12,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 405bdcc0cafe6c5fe7e0825a7b7c50cf, disabling compactions & flushes 2023-10-31 05:54:12,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:13,020 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/.tmp/family1/b73f156c3927436f99638e1a0884f0a0 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/b73f156c3927436f99638e1a0884f0a0 2023-10-31 05:54:13,028 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 of 405bdcc0cafe6c5fe7e0825a7b7c50cf into b73f156c3927436f99638e1a0884f0a0(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:54:13,028 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:13,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:13,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:13,028 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1698731651763; duration=1sec 2023-10-31 05:54:13,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. after waiting 0 ms 2023-10-31 05:54:13,028 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:54:13,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:13,032 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5361b2c8e0ff4d5aa66ea5da0aa3be08, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/1a49c1e6cc214c9797d0d1baec178bb3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/de43eb2a03e1414ba5b4f82fb5658d07_SeqId_47_] to archive 2023-10-31 05:54:13,033 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:13,036 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5361b2c8e0ff4d5aa66ea5da0aa3be08 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/5361b2c8e0ff4d5aa66ea5da0aa3be08 2023-10-31 05:54:13,038 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/1a49c1e6cc214c9797d0d1baec178bb3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/1a49c1e6cc214c9797d0d1baec178bb3 2023-10-31 05:54:13,040 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/de43eb2a03e1414ba5b4f82fb5658d07_SeqId_47_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/de43eb2a03e1414ba5b4f82fb5658d07_SeqId_47_ 2023-10-31 05:54:13,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-31 05:54:13,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:13,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:13,050 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 405bdcc0cafe6c5fe7e0825a7b7c50cf to self. 2023-10-31 05:54:13,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:13,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=405bdcc0cafe6c5fe7e0825a7b7c50cf, regionState=CLOSED 2023-10-31 05:54:13,053 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731653052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731653052"}]},"ts":"1698731653052"} 2023-10-31 05:54:13,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-10-31 05:54:13,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 405bdcc0cafe6c5fe7e0825a7b7c50cf, server=jenkins-hbase20.apache.org,43723,1698731565849 in 790 msec 2023-10-31 05:54:13,057 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=true 2023-10-31 05:54:13,208 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=405bdcc0cafe6c5fe7e0825a7b7c50cf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:13,208 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731653208"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731653208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731653208"}]},"ts":"1698731653208"} 2023-10-31 05:54:13,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 405bdcc0cafe6c5fe7e0825a7b7c50cf, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:13,365 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:13,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:13,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 405bdcc0cafe6c5fe7e0825a7b7c50cf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:54:13,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:13,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:13,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:13,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:13,373 INFO [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:13,374 DEBUG [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:54:13,374 DEBUG [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:54:13,375 INFO [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 405bdcc0cafe6c5fe7e0825a7b7c50cf columnFamilyName family1 2023-10-31 05:54:13,384 DEBUG [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/b73f156c3927436f99638e1a0884f0a0 2023-10-31 05:54:13,385 INFO [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] regionserver.HStore(310): Store=405bdcc0cafe6c5fe7e0825a7b7c50cf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:13,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:13,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:13,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:13,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 405bdcc0cafe6c5fe7e0825a7b7c50cf; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59421633, jitterRate=-0.11454866826534271}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:54:13,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:13,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf., pid=63, masterSystemTime=1698731653365 2023-10-31 05:54:13,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:13,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:13,399 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=405bdcc0cafe6c5fe7e0825a7b7c50cf, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:13,399 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731653399"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731653399"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731653399"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731653399"}]},"ts":"1698731653399"} 2023-10-31 05:54:13,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-10-31 05:54:13,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 405bdcc0cafe6c5fe7e0825a7b7c50cf, server=jenkins-hbase20.apache.org,43723,1698731565849 in 190 msec 2023-10-31 05:54:13,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-10-31 05:54:13,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, REOPEN/MOVE in 1.1420 sec 2023-10-31 05:54:13,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-31 05:54:13,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1480 sec 2023-10-31 05:54:13,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5660 sec 2023-10-31 05:54:13,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-10-31 05:54:13,416 INFO [Listener at localhost/40291] compactions.TestMobCompactor(278): alter status finished 2023-10-31 05:54:13,417 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:13,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-31 05:54:13,418 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-31 05:54:13,419 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:54:13,419 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732253419 2023-10-31 05:54:13,420 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:54:13,420 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-31 05:54:13,420 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:13,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x6caf949f to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:54:13,425 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e7602df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:54:13,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:13,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:13,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:13,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:13,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:13,854 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286199c42b7fa541f0b09cfbf48f8637f6 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286199c42b7fa541f0b09cfbf48f8637f6 2023-10-31 05:54:13,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:13,868 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:54:13,869 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:54:13,875 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:54:13,877 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:54:13,885 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a9f1724a0de44c9ae28b9bd6b74f351 first=Optional[r05] last=Optional[r8] 2023-10-31 05:54:13,885 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=51 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a9f1724a0de44c9ae28b9bd6b74f351}] 2023-10-31 05:54:13,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a9f1724a0de44c9ae28b9bd6b74f351 for inclusion in 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:54:13,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-31 05:54:13,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:54:13,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:13,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a9f1724a0de44c9ae28b9bd6b74f351 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__7iumavj3r34472833fedhjii75b8rcvbuffhb2lhkml0nf028s55g4gln5u0mshm/family1/7a9f1724a0de44c9ae28b9bd6b74f351 2023-10-31 05:54:13,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__7iumavj3r34472833fedhjii75b8rcvbuffhb2lhkml0nf028s55g4gln5u0mshm/family1/7a9f1724a0de44c9ae28b9bd6b74f351 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/df5df5978f6c44269379e3f760ee3c60_SeqId_53_ 2023-10-31 05:54:13,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__7iumavj3r34472833fedhjii75b8rcvbuffhb2lhkml0nf028s55g4gln5u0mshm/family1/7a9f1724a0de44c9ae28b9bd6b74f351 into 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/df5df5978f6c44269379e3f760ee3c60_SeqId_53_ - updating store file list. 2023-10-31 05:54:13,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/df5df5978f6c44269379e3f760ee3c60_SeqId_53_ into 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:54:13,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__7iumavj3r34472833fedhjii75b8rcvbuffhb2lhkml0nf028s55g4gln5u0mshm/family1/7a9f1724a0de44c9ae28b9bd6b74f351 into 405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/df5df5978f6c44269379e3f760ee3c60_SeqId_53_) 2023-10-31 05:54:13,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__7iumavj3r34472833fedhjii75b8rcvbuffhb2lhkml0nf028s55g4gln5u0mshm/family1/7a9f1724a0de44c9ae28b9bd6b74f351 2023-10-31 05:54:13,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:13,907 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:13,909 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120c7962c8db0e847ecb8db0d9e01c54700 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120c7962c8db0e847ecb8db0d9e01c54700 2023-10-31 05:54:13,910 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286e49aef125e64cd2ac89ea910bc7f5d9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286e49aef125e64cd2ac89ea910bc7f5d9 2023-10-31 05:54:13,910 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-10-31 05:54:13,910 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-31 05:54:13,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:13,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:13,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:13,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:13,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:54:13,912 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-31 05:54:13,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 495 msec 2023-10-31 05:54:13,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-10-31 05:54:13,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:14,380 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-31 05:54:14,382 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-31 05:54:14,383 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-31 05:54:14,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-31 05:54:14,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, REOPEN/MOVE}] 2023-10-31 05:54:14,393 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, REOPEN/MOVE 2023-10-31 05:54:14,394 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=405bdcc0cafe6c5fe7e0825a7b7c50cf, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:14,394 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731654394"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731654394"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731654394"}]},"ts":"1698731654394"} 2023-10-31 05:54:14,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 405bdcc0cafe6c5fe7e0825a7b7c50cf, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:14,547 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:14,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:14,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 405bdcc0cafe6c5fe7e0825a7b7c50cf, disabling compactions & flushes 2023-10-31 05:54:14,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:14,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:14,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. after waiting 0 ms 2023-10-31 05:54:14,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:14,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-31 05:54:14,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:14,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:14,565 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 405bdcc0cafe6c5fe7e0825a7b7c50cf to self. 2023-10-31 05:54:14,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:14,569 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=405bdcc0cafe6c5fe7e0825a7b7c50cf, regionState=CLOSED 2023-10-31 05:54:14,569 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731654569"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731654569"}]},"ts":"1698731654569"} 2023-10-31 05:54:14,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-10-31 05:54:14,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 405bdcc0cafe6c5fe7e0825a7b7c50cf, server=jenkins-hbase20.apache.org,43723,1698731565849 in 175 msec 2023-10-31 05:54:14,574 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=true 2023-10-31 05:54:14,725 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=405bdcc0cafe6c5fe7e0825a7b7c50cf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:14,725 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731654725"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731654725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731654725"}]},"ts":"1698731654725"} 2023-10-31 05:54:14,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 405bdcc0cafe6c5fe7e0825a7b7c50cf, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:14,878 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:14,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:14,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 405bdcc0cafe6c5fe7e0825a7b7c50cf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:54:14,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:14,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:14,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:14,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:14,887 INFO [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:14,889 DEBUG [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:54:14,889 DEBUG [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1 2023-10-31 05:54:14,890 INFO [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 405bdcc0cafe6c5fe7e0825a7b7c50cf columnFamilyName family1 2023-10-31 05:54:14,900 DEBUG [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/b73f156c3927436f99638e1a0884f0a0 2023-10-31 05:54:14,905 DEBUG [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/family1/df5df5978f6c44269379e3f760ee3c60_SeqId_53_ 2023-10-31 05:54:14,905 INFO [StoreOpener-405bdcc0cafe6c5fe7e0825a7b7c50cf-1] regionserver.HStore(310): Store=405bdcc0cafe6c5fe7e0825a7b7c50cf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:14,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:14,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:14,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:54:14,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 405bdcc0cafe6c5fe7e0825a7b7c50cf; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66381042, jitterRate=-0.010845392942428589}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:54:14,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:54:14,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf., pid=69, masterSystemTime=1698731654878 2023-10-31 05:54:14,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:14,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:54:14,916 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=405bdcc0cafe6c5fe7e0825a7b7c50cf, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:14,917 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698731654916"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731654916"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731654916"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731654916"}]},"ts":"1698731654916"} 2023-10-31 05:54:14,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-31 05:54:14,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 405bdcc0cafe6c5fe7e0825a7b7c50cf, server=jenkins-hbase20.apache.org,43723,1698731565849 in 193 msec 2023-10-31 05:54:14,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-31 05:54:14,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=405bdcc0cafe6c5fe7e0825a7b7c50cf, REOPEN/MOVE in 529 msec 2023-10-31 05:54:14,926 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-10-31 05:54:14,926 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 537 msec 2023-10-31 05:54:14,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 959 msec 2023-10-31 05:54:14,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-10-31 05:54:14,929 INFO [Listener at localhost/40291] compactions.TestMobCompactor(278): alter status finished 2023-10-31 05:54:14,930 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-31 05:54:14,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-31 05:54:14,931 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-31 05:54:14,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:54:14,932 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732254932 2023-10-31 05:54:14,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:54:14,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-31 05:54:14,933 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:14,935 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x197f8d20 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:54:14,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69c1eb02, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:54:14,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:14,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:14,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:14,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:14,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:14,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:14,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:14,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-31 05:54:14,939 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-31 05:54:14,939 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:54:14,940 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-31 05:54:14,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-10-31 05:54:14,990 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=256 (was 248) - Thread LEAK? -, OpenFileDescriptor=656 (was 616) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=175 (was 216), ProcessCount=169 (was 169), AvailableMemoryMB=1336 (was 1337) 2023-10-31 05:54:15,000 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=256, OpenFileDescriptor=656, MaxFileDescriptor=60000, SystemLoadAverage=175, ProcessCount=169, AvailableMemoryMB=1335 2023-10-31 05:54:15,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-31 05:54:15,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-10-31 05:54:15,006 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:54:15,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-10-31 05:54:15,007 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:54:15,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-31 05:54:15,008 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:15,008 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1 empty. 2023-10-31 05:54:15,008 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:15,009 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-31 05:54:15,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-31 05:54:15,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-31 05:54:15,420 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-10-31 05:54:15,423 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6d5805fb5e03ee7a09ad86b201e471f1, NAME => 'testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:54:15,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-31 05:54:15,831 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:15,831 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 6d5805fb5e03ee7a09ad86b201e471f1, disabling compactions & flushes 2023-10-31 05:54:15,831 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:15,831 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:15,831 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. after waiting 0 ms 2023-10-31 05:54:15,831 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:15,831 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:15,831 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 6d5805fb5e03ee7a09ad86b201e471f1: 2023-10-31 05:54:15,835 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:54:15,837 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698731655836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731655836"}]},"ts":"1698731655836"} 2023-10-31 05:54:15,838 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-31 05:54:15,840 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:54:15,840 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731655840"}]},"ts":"1698731655840"} 2023-10-31 05:54:15,841 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-10-31 05:54:15,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=6d5805fb5e03ee7a09ad86b201e471f1, ASSIGN}] 2023-10-31 05:54:15,848 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=6d5805fb5e03ee7a09ad86b201e471f1, ASSIGN 2023-10-31 05:54:15,849 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=6d5805fb5e03ee7a09ad86b201e471f1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:54:16,000 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6d5805fb5e03ee7a09ad86b201e471f1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:16,001 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698731656000"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731656000"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731656000"}]},"ts":"1698731656000"} 2023-10-31 05:54:16,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 6d5805fb5e03ee7a09ad86b201e471f1, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:16,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-31 05:54:16,157 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:16,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:16,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d5805fb5e03ee7a09ad86b201e471f1, NAME => 'testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:54:16,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-10-31 05:54:16,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-10-31 05:54:16,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:16,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:16,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:16,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:16,172 INFO [StoreOpener-6d5805fb5e03ee7a09ad86b201e471f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:16,174 DEBUG [StoreOpener-6d5805fb5e03ee7a09ad86b201e471f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1 2023-10-31 05:54:16,174 DEBUG [StoreOpener-6d5805fb5e03ee7a09ad86b201e471f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1 2023-10-31 05:54:16,175 INFO [StoreOpener-6d5805fb5e03ee7a09ad86b201e471f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d5805fb5e03ee7a09ad86b201e471f1 columnFamilyName f1 2023-10-31 05:54:16,177 INFO [StoreOpener-6d5805fb5e03ee7a09ad86b201e471f1-1] regionserver.HStore(310): Store=6d5805fb5e03ee7a09ad86b201e471f1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:16,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:16,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:16,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:16,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:54:16,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6d5805fb5e03ee7a09ad86b201e471f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68990707, jitterRate=0.028041645884513855}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:54:16,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6d5805fb5e03ee7a09ad86b201e471f1: 2023-10-31 05:54:16,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1., pid=73, masterSystemTime=1698731656157 2023-10-31 05:54:16,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:16,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:16,187 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6d5805fb5e03ee7a09ad86b201e471f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:16,188 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698731656187"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731656187"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731656187"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731656187"}]},"ts":"1698731656187"} 2023-10-31 05:54:16,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-10-31 05:54:16,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 6d5805fb5e03ee7a09ad86b201e471f1, server=jenkins-hbase20.apache.org,43723,1698731565849 in 186 msec 2023-10-31 05:54:16,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-31 05:54:16,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=6d5805fb5e03ee7a09ad86b201e471f1, ASSIGN in 345 msec 2023-10-31 05:54:16,192 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:54:16,192 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731656192"}]},"ts":"1698731656192"} 2023-10-31 05:54:16,193 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-10-31 05:54:16,195 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:54:16,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1910 sec 2023-10-31 05:54:17,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-31 05:54:17,120 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-10-31 05:54:17,121 DEBUG [Listener at localhost/40291] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-10-31 05:54:17,126 INFO [Listener at localhost/40291] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-31 05:54:17,129 INFO [Listener at localhost/40291] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-10-31 05:54:17,130 INFO [Listener at localhost/40291] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-31 05:54:17,130 INFO [Listener at localhost/40291] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-10-31 05:54:17,135 INFO [Listener at localhost/40291] regionserver.HRegion(2745): Flushing 6d5805fb5e03ee7a09ad86b201e471f1 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-31 05:54:17,551 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031bb1e0e758dd1474f94652b7742d2091a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231031bb1e0e758dd1474f94652b7742d2091a 2023-10-31 05:54:17,581 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-10-31 05:54:17,958 INFO [Listener at localhost/40291] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/.tmp/f1/6c7533828d3243ecb19535c25a34fe92 2023-10-31 05:54:17,964 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/.tmp/f1/6c7533828d3243ecb19535c25a34fe92 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92 2023-10-31 05:54:17,968 INFO [Listener at localhost/40291] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92, entries=1, sequenceid=5, filesize=4.9 K 2023-10-31 05:54:17,969 INFO [Listener at localhost/40291] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 6d5805fb5e03ee7a09ad86b201e471f1 in 834ms, sequenceid=5, compaction requested=false 2023-10-31 05:54:17,970 DEBUG [Listener at localhost/40291] regionserver.HRegion(2446): Flush status journal for 6d5805fb5e03ee7a09ad86b201e471f1: 2023-10-31 05:54:17,971 INFO [Listener at localhost/40291] regionserver.HRegion(2745): Flushing 6d5805fb5e03ee7a09ad86b201e471f1 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-31 05:54:18,073 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:54:18,073 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04a68b9a to 127.0.0.1:64652 2023-10-31 05:54:18,073 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:54:18,073 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:54:18,074 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6caf949f to 127.0.0.1:64652 2023-10-31 05:54:18,074 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:54:18,074 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x197f8d20 to 127.0.0.1:64652 2023-10-31 05:54:18,074 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:54:18,075 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:54:18,075 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a769b34 to 127.0.0.1:64652 2023-10-31 05:54:18,075 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:54:18,075 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x708ad360 to 127.0.0.1:64652 2023-10-31 05:54:18,075 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:54:18,075 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:54:18,075 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a6ce160 to 127.0.0.1:64652 2023-10-31 05:54:18,075 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:54:18,076 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:54:18,076 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x698d7b9c to 127.0.0.1:64652 2023-10-31 05:54:18,076 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:54:18,390 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031e7b79d78001b4f8c801a722203f97110 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231031e7b79d78001b4f8c801a722203f97110 2023-10-31 05:54:18,597 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:54:18,799 INFO [Listener at localhost/40291] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/.tmp/f1/1d78f67410b842e09bdf5511424189dd 2023-10-31 05:54:18,808 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/.tmp/f1/1d78f67410b842e09bdf5511424189dd as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd 2023-10-31 05:54:18,813 INFO [Listener at localhost/40291] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd, entries=1, sequenceid=9, filesize=4.9 K 2023-10-31 05:54:18,814 INFO [Listener at localhost/40291] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 6d5805fb5e03ee7a09ad86b201e471f1 in 843ms, sequenceid=9, compaction requested=false 2023-10-31 05:54:18,814 DEBUG [Listener at localhost/40291] regionserver.HRegion(2446): Flush status journal for 6d5805fb5e03ee7a09ad86b201e471f1: 2023-10-31 05:54:18,816 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-10-31 05:54:18,817 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-31 05:54:18,818 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-31 05:54:18,818 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:54:18,818 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732258818 2023-10-31 05:54:18,819 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-31 05:54:18,819 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-10-31 05:54:18,819 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-10-31 05:54:18,821 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x06ab395e to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:54:18,824 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60545b72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:54:18,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231031 for table='testGetAfterCompaction' and column='f1' 2023-10-31 05:54:18,867 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:18,868 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:18,918 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:18,918 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:18,969 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:18,969 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,021 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,021 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,072 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,072 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,124 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,125 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,176 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,176 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,227 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,227 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,278 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,278 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,330 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,330 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,382 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,382 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,433 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,434 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,484 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,485 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,536 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,536 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,587 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,587 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,638 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,638 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,652 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310311a22d4aa31e64f2796a43084bf2db9a5 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310311a22d4aa31e64f2796a43084bf2db9a5 2023-10-31 05:54:19,652 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231031 table='testGetAfterCompaction' column='f1' 2023-10-31 05:54:19,662 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:54:19,663 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:54:19,669 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:54:19,671 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:54:19,680 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231031/f1/8a7b8d9221714e76b3317da971bb9ffe first=Optional[r1] last=Optional[r2] 2023-10-31 05:54:19,681 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{f1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231031/f1/8a7b8d9221714e76b3317da971bb9ffe}] 2023-10-31 05:54:19,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231031/f1/8a7b8d9221714e76b3317da971bb9ffe for inclusion in 6d5805fb5e03ee7a09ad86b201e471f1/f1 2023-10-31 05:54:19,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-31 05:54:19,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:54:19,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 6d5805fb5e03ee7a09ad86b201e471f1: 2023-10-31 05:54:19,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231031/f1/8a7b8d9221714e76b3317da971bb9ffe to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testGetAfterCompaction__ojr16bua5e02dqe15r3ngpincv9cb60f3veegfpaagpt1md0m9geb6rm8pq8op2m/f1/8a7b8d9221714e76b3317da971bb9ffe 2023-10-31 05:54:19,689 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,689 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testGetAfterCompaction__ojr16bua5e02dqe15r3ngpincv9cb60f3veegfpaagpt1md0m9geb6rm8pq8op2m/f1/8a7b8d9221714e76b3317da971bb9ffe as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_ 2023-10-31 05:54:19,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testGetAfterCompaction__ojr16bua5e02dqe15r3ngpincv9cb60f3veegfpaagpt1md0m9geb6rm8pq8op2m/f1/8a7b8d9221714e76b3317da971bb9ffe into 6d5805fb5e03ee7a09ad86b201e471f1/f1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_ - updating store file list. 2023-10-31 05:54:19,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_ into 6d5805fb5e03ee7a09ad86b201e471f1/f1 2023-10-31 05:54:19,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testGetAfterCompaction__ojr16bua5e02dqe15r3ngpincv9cb60f3veegfpaagpt1md0m9geb6rm8pq8op2m/f1/8a7b8d9221714e76b3317da971bb9ffe into 6d5805fb5e03ee7a09ad86b201e471f1/f1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_) 2023-10-31 05:54:19,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testGetAfterCompaction__ojr16bua5e02dqe15r3ngpincv9cb60f3veegfpaagpt1md0m9geb6rm8pq8op2m/f1/8a7b8d9221714e76b3317da971bb9ffe 2023-10-31 05:54:19,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): 6d5805fb5e03ee7a09ad86b201e471f1/f1 is initiating minor compaction 2023-10-31 05:54:19,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@381f1a5b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:54:19,694 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 6d5805fb5e03ee7a09ad86b201e471f1/f1 in testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:19,694 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/.tmp, totalSize=10.0 K 2023-10-31 05:54:19,694 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting 1d78f67410b842e09bdf5511424189dd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-31 05:54:19,694 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting 8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-31 05:54:19,696 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231031 table='testGetAfterCompaction' column='f1' 2023-10-31 05:54:19,697 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:19,698 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231031bb1e0e758dd1474f94652b7742d2091a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231031bb1e0e758dd1474f94652b7742d2091a 2023-10-31 05:54:19,699 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231031e7b79d78001b4f8c801a722203f97110 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231031e7b79d78001b4f8c801a722203f97110 2023-10-31 05:54:19,699 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-10-31 05:54:19,699 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231031' 2023-10-31 05:54:19,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231031 for table='testGetAfterCompaction' and column='f1' 2023-10-31 05:54:19,699 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-10-31 05:54:19,700 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:54:19,700 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-31 05:54:19,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 884 msec 2023-10-31 05:54:19,702 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] throttle.PressureAwareThroughputController(145): 6d5805fb5e03ee7a09ad86b201e471f1#f1#compaction#76 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:19,740 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,740 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,740 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:19,743 DEBUG [Listener at localhost/40291] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-31 05:54:19,746 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-31 05:54:19,746 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43723] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:19,747 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-10-31 05:54:19,747 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-31 05:54:19,747 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43723] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-31 05:54:19,747 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43723] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. because compaction request was cancelled 2023-10-31 05:54:19,799 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,799 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,799 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:19,850 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,850 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,850 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:19,901 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,902 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,902 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:19,953 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,953 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:19,953 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,005 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,005 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,005 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,057 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,057 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,057 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,109 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,109 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,109 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,161 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,161 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,161 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,213 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,213 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,213 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,265 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,265 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,265 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,317 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,317 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,317 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,369 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,369 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,369 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,421 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,421 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,422 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,472 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,472 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,473 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,523 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,523 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,523 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,527 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/.tmp/f1/39637576994d46bf89a70d9f806d7aa6 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/39637576994d46bf89a70d9f806d7aa6 2023-10-31 05:54:20,534 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 6d5805fb5e03ee7a09ad86b201e471f1/f1 of 6d5805fb5e03ee7a09ad86b201e471f1 into 39637576994d46bf89a70d9f806d7aa6(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:54:20,534 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6d5805fb5e03ee7a09ad86b201e471f1: 2023-10-31 05:54:20,534 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1698731659694; duration=0sec 2023-10-31 05:54:20,534 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:54:20,575 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731658798; access_time=1698731657973; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,575 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/39637576994d46bf89a70d9f806d7aa6; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698731660521; access_time=1698731659699; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,575 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,575 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698731659648; access_time=1698731658836; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-31 05:54:20,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_] to archive 2023-10-31 05:54:20,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:20,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/1d78f67410b842e09bdf5511424189dd 2023-10-31 05:54:20,615 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/8e3e0a7bc2914b5caafd307f1a6df329_SeqId_12_ 2023-10-31 05:54:20,626 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/39637576994d46bf89a70d9f806d7aa6; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698731660521; access_time=1698731659699; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,626 INFO [Listener at localhost/40291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698731657958; access_time=1698731657139; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-31 05:54:20,759 INFO [Listener at localhost/40291] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-10-31 05:54:20,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-10-31 05:54:20,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-10-31 05:54:20,775 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731660775"}]},"ts":"1698731660775"} 2023-10-31 05:54:20,777 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-10-31 05:54:20,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-31 05:54:20,777 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-10-31 05:54:20,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=6d5805fb5e03ee7a09ad86b201e471f1, UNASSIGN}] 2023-10-31 05:54:20,780 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=6d5805fb5e03ee7a09ad86b201e471f1, UNASSIGN 2023-10-31 05:54:20,780 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6d5805fb5e03ee7a09ad86b201e471f1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:20,780 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698731660780"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731660780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731660780"}]},"ts":"1698731660780"} 2023-10-31 05:54:20,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 6d5805fb5e03ee7a09ad86b201e471f1, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:20,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-31 05:54:20,932 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:20,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:20,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6d5805fb5e03ee7a09ad86b201e471f1, disabling compactions & flushes 2023-10-31 05:54:20,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:20,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:20,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. after waiting 0 ms 2023-10-31 05:54:20,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:20,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-31 05:54:20,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-31 05:54:20,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1. 2023-10-31 05:54:20,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6d5805fb5e03ee7a09ad86b201e471f1: 2023-10-31 05:54:20,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:20,950 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6d5805fb5e03ee7a09ad86b201e471f1, regionState=CLOSED 2023-10-31 05:54:20,950 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698731660950"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731660950"}]},"ts":"1698731660950"} 2023-10-31 05:54:20,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-31 05:54:20,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 6d5805fb5e03ee7a09ad86b201e471f1, server=jenkins-hbase20.apache.org,43723,1698731565849 in 171 msec 2023-10-31 05:54:20,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-10-31 05:54:20,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=6d5805fb5e03ee7a09ad86b201e471f1, UNASSIGN in 176 msec 2023-10-31 05:54:20,959 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731660959"}]},"ts":"1698731660959"} 2023-10-31 05:54:20,961 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-10-31 05:54:20,962 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-10-31 05:54:20,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 198 msec 2023-10-31 05:54:21,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-31 05:54:21,081 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-10-31 05:54:21,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-10-31 05:54:21,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-10-31 05:54:21,097 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-31 05:54:21,099 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-31 05:54:21,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-31 05:54:21,101 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:21,103 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1, FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/recovered.edits] 2023-10-31 05:54:21,106 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/39637576994d46bf89a70d9f806d7aa6 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/39637576994d46bf89a70d9f806d7aa6 2023-10-31 05:54:21,107 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/f1/6c7533828d3243ecb19535c25a34fe92 2023-10-31 05:54:21,109 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/recovered.edits/15.seqid to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1/recovered.edits/15.seqid 2023-10-31 05:54:21,110 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testGetAfterCompaction/6d5805fb5e03ee7a09ad86b201e471f1 2023-10-31 05:54:21,110 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-31 05:54:21,110 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-31 05:54:21,111 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-10-31 05:54:21,114 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310311a22d4aa31e64f2796a43084bf2db9a5 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310311a22d4aa31e64f2796a43084bf2db9a5 2023-10-31 05:54:21,114 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-31 05:54:21,116 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-31 05:54:21,135 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-10-31 05:54:21,137 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-10-31 05:54:21,138 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-31 05:54:21,138 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-10-31 05:54:21,138 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698731661138"}]},"ts":"9223372036854775807"} 2023-10-31 05:54:21,139 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-31 05:54:21,139 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6d5805fb5e03ee7a09ad86b201e471f1, NAME => 'testGetAfterCompaction,,1698731655003.6d5805fb5e03ee7a09ad86b201e471f1.', STARTKEY => '', ENDKEY => ''}] 2023-10-31 05:54:21,140 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-10-31 05:54:21,140 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1698731661140"}]},"ts":"9223372036854775807"} 2023-10-31 05:54:21,141 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-10-31 05:54:21,142 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-31 05:54:21,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 50 msec 2023-10-31 05:54:21,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-31 05:54:21,201 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-10-31 05:54:21,218 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=237 (was 256), OpenFileDescriptor=597 (was 656), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 175), ProcessCount=169 (was 169), AvailableMemoryMB=1330 (was 1335) 2023-10-31 05:54:21,232 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=237, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=161, ProcessCount=169, AvailableMemoryMB=1329 2023-10-31 05:54:21,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-31 05:54:21,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-10-31 05:54:21,236 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:54:21,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-10-31 05:54:21,237 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:54:21,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-31 05:54:21,239 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:21,239 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:21,239 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:21,239 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb empty. 2023-10-31 05:54:21,239 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882 empty. 2023-10-31 05:54:21,239 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf empty. 2023-10-31 05:54:21,239 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:21,239 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:21,239 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:21,239 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-10-31 05:54:21,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-31 05:54:21,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-31 05:54:21,650 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-31 05:54:21,653 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => f22d093a048d2c7989ada8d66d0a76fb, NAME => 'testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:54:21,654 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => eb42a9600adc7511b8ec2d129b0a1882, NAME => 'testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:54:21,654 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => b7e12c6f039ff414ef8eee79c79535bf, NAME => 'testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:54:21,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-31 05:54:22,073 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:22,073 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:22,073 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing b7e12c6f039ff414ef8eee79c79535bf, disabling compactions & flushes 2023-10-31 05:54:22,073 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:22,073 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:22,073 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:22,073 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing f22d093a048d2c7989ada8d66d0a76fb, disabling compactions & flushes 2023-10-31 05:54:22,074 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:22,074 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. after waiting 0 ms 2023-10-31 05:54:22,074 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing eb42a9600adc7511b8ec2d129b0a1882, disabling compactions & flushes 2023-10-31 05:54:22,074 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:22,074 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:22,074 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:22,074 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:22,074 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:22,074 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. after waiting 0 ms 2023-10-31 05:54:22,074 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:22,074 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:22,075 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:22,074 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:22,075 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. after waiting 0 ms 2023-10-31 05:54:22,075 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:22,075 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:22,075 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:22,079 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:54:22,080 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731662080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731662080"}]},"ts":"1698731662080"} 2023-10-31 05:54:22,081 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731662080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731662080"}]},"ts":"1698731662080"} 2023-10-31 05:54:22,081 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731662080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731662080"}]},"ts":"1698731662080"} 2023-10-31 05:54:22,083 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-31 05:54:22,084 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:54:22,084 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731662084"}]},"ts":"1698731662084"} 2023-10-31 05:54:22,085 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-31 05:54:22,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, ASSIGN}] 2023-10-31 05:54:22,089 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, ASSIGN 2023-10-31 05:54:22,089 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, ASSIGN 2023-10-31 05:54:22,089 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, ASSIGN 2023-10-31 05:54:22,090 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:54:22,090 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:54:22,090 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:54:22,242 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f22d093a048d2c7989ada8d66d0a76fb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:22,242 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=b7e12c6f039ff414ef8eee79c79535bf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:22,242 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731662242"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731662242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731662242"}]},"ts":"1698731662242"} 2023-10-31 05:54:22,242 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=eb42a9600adc7511b8ec2d129b0a1882, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:22,242 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731662242"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731662242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731662242"}]},"ts":"1698731662242"} 2023-10-31 05:54:22,243 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731662242"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731662242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731662242"}]},"ts":"1698731662242"} 2023-10-31 05:54:22,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure f22d093a048d2c7989ada8d66d0a76fb, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:22,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure b7e12c6f039ff414ef8eee79c79535bf, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:22,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure eb42a9600adc7511b8ec2d129b0a1882, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:22,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-31 05:54:22,399 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:22,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:22,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b7e12c6f039ff414ef8eee79c79535bf, NAME => 'testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.', STARTKEY => '2', ENDKEY => ''} 2023-10-31 05:54:22,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:22,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:22,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:22,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:22,408 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:22,410 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1 2023-10-31 05:54:22,410 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1 2023-10-31 05:54:22,411 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7e12c6f039ff414ef8eee79c79535bf columnFamilyName family1 2023-10-31 05:54:22,412 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(310): Store=b7e12c6f039ff414ef8eee79c79535bf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:22,412 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:22,413 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2 2023-10-31 05:54:22,413 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2 2023-10-31 05:54:22,413 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7e12c6f039ff414ef8eee79c79535bf columnFamilyName family2 2023-10-31 05:54:22,414 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(310): Store=b7e12c6f039ff414ef8eee79c79535bf/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:22,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:22,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:22,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:54:22,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:22,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:54:22,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b7e12c6f039ff414ef8eee79c79535bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62974046, jitterRate=-0.06161358952522278}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:54:22,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:22,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf., pid=84, masterSystemTime=1698731662399 2023-10-31 05:54:22,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:22,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:22,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:22,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f22d093a048d2c7989ada8d66d0a76fb, NAME => 'testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.', STARTKEY => '', ENDKEY => '1'} 2023-10-31 05:54:22,421 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=b7e12c6f039ff414ef8eee79c79535bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:22,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:22,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:22,422 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731662421"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731662421"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731662421"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731662421"}]},"ts":"1698731662421"} 2023-10-31 05:54:22,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:22,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:22,423 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:22,424 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1 2023-10-31 05:54:22,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=82 2023-10-31 05:54:22,424 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1 2023-10-31 05:54:22,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure b7e12c6f039ff414ef8eee79c79535bf, server=jenkins-hbase20.apache.org,43723,1698731565849 in 178 msec 2023-10-31 05:54:22,424 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f22d093a048d2c7989ada8d66d0a76fb columnFamilyName family1 2023-10-31 05:54:22,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, ASSIGN in 337 msec 2023-10-31 05:54:22,425 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(310): Store=f22d093a048d2c7989ada8d66d0a76fb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:22,426 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:22,427 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2 2023-10-31 05:54:22,427 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2 2023-10-31 05:54:22,427 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f22d093a048d2c7989ada8d66d0a76fb columnFamilyName family2 2023-10-31 05:54:22,428 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(310): Store=f22d093a048d2c7989ada8d66d0a76fb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:22,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:22,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:22,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:54:22,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:22,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:54:22,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f22d093a048d2c7989ada8d66d0a76fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71328122, jitterRate=0.06287184357643127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:54:22,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:22,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb., pid=83, masterSystemTime=1698731662399 2023-10-31 05:54:22,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:22,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:22,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:22,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb42a9600adc7511b8ec2d129b0a1882, NAME => 'testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.', STARTKEY => '1', ENDKEY => '2'} 2023-10-31 05:54:22,435 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f22d093a048d2c7989ada8d66d0a76fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:22,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:22,435 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731662435"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731662435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731662435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731662435"}]},"ts":"1698731662435"} 2023-10-31 05:54:22,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:22,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:22,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:22,436 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:22,437 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=80 2023-10-31 05:54:22,437 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1 2023-10-31 05:54:22,438 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure f22d093a048d2c7989ada8d66d0a76fb, server=jenkins-hbase20.apache.org,43723,1698731565849 in 192 msec 2023-10-31 05:54:22,438 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1 2023-10-31 05:54:22,438 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb42a9600adc7511b8ec2d129b0a1882 columnFamilyName family1 2023-10-31 05:54:22,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, ASSIGN in 352 msec 2023-10-31 05:54:22,439 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(310): Store=eb42a9600adc7511b8ec2d129b0a1882/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:22,439 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:22,440 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2 2023-10-31 05:54:22,440 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2 2023-10-31 05:54:22,440 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb42a9600adc7511b8ec2d129b0a1882 columnFamilyName family2 2023-10-31 05:54:22,441 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(310): Store=eb42a9600adc7511b8ec2d129b0a1882/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:22,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:22,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:22,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:54:22,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:22,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:54:22,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened eb42a9600adc7511b8ec2d129b0a1882; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74130965, jitterRate=0.10463745892047882}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:54:22,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:22,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882., pid=85, masterSystemTime=1698731662399 2023-10-31 05:54:22,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:22,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:22,448 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=eb42a9600adc7511b8ec2d129b0a1882, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:22,448 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731662448"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731662448"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731662448"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731662448"}]},"ts":"1698731662448"} 2023-10-31 05:54:22,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=81 2023-10-31 05:54:22,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure eb42a9600adc7511b8ec2d129b0a1882, server=jenkins-hbase20.apache.org,43723,1698731565849 in 202 msec 2023-10-31 05:54:22,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=79 2023-10-31 05:54:22,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, ASSIGN in 364 msec 2023-10-31 05:54:22,452 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:54:22,452 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731662452"}]},"ts":"1698731662452"} 2023-10-31 05:54:22,453 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-31 05:54:22,455 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:54:22,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2200 sec 2023-10-31 05:54:23,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-31 05:54:23,348 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-10-31 05:54:23,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:23,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:23,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:23,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:23,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-31 05:54:23,367 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-31 05:54:23,367 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:23,367 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-31 05:54:23,367 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-31 05:54:23,367 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:23,367 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:23,368 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:23,368 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:23,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:23,369 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:23,369 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:23,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:23,369 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-31 05:54:23,369 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-31 05:54:23,369 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-31 05:54:23,370 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:23,370 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-31 05:54:23,370 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:23,370 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. started... 2023-10-31 05:54:23,371 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:23,371 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f22d093a048d2c7989ada8d66d0a76fb 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-31 05:54:23,371 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. started... 2023-10-31 05:54:23,373 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:54:23,373 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:23,373 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b7e12c6f039ff414ef8eee79c79535bf 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-31 05:54:23,373 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:23,373 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. started... 2023-10-31 05:54:23,374 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing eb42a9600adc7511b8ec2d129b0a1882 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-31 05:54:23,392 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031600b2f80e18f4286b54c1b0be5c7ae4f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031600b2f80e18f4286b54c1b0be5c7ae4f 2023-10-31 05:54:23,583 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-31 05:54:23,793 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103197580ffd55b3462f885c5e51c2f01fb0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023103197580ffd55b3462f885c5e51c2f01fb0 2023-10-31 05:54:23,794 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310314f9e0582898040b697e45d0aee7063da to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310314f9e0582898040b697e45d0aee7063da 2023-10-31 05:54:23,797 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/a622f2699c4c4fc99b23c53fed503e57 2023-10-31 05:54:23,798 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/9287dde0b3254eabb55ecc6bdad2e400 2023-10-31 05:54:24,199 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/2774acb1012f42999a4abecb50e157bb 2023-10-31 05:54:24,218 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031298690a82a0a4e70ba6a01d6636e82d8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231031298690a82a0a4e70ba6a01d6636e82d8 2023-10-31 05:54:24,224 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310313f598e186dd04cf1805d8c07f321b188 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310313f598e186dd04cf1805d8c07f321b188 2023-10-31 05:54:24,230 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/85100bf9ebc14d4eb9777c58d74f5795 2023-10-31 05:54:24,235 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/9287dde0b3254eabb55ecc6bdad2e400 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/9287dde0b3254eabb55ecc6bdad2e400 2023-10-31 05:54:24,238 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/9287dde0b3254eabb55ecc6bdad2e400, entries=4, sequenceid=5, filesize=5.4 K 2023-10-31 05:54:24,239 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/85100bf9ebc14d4eb9777c58d74f5795 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/85100bf9ebc14d4eb9777c58d74f5795 2023-10-31 05:54:24,242 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/85100bf9ebc14d4eb9777c58d74f5795, entries=2, sequenceid=5, filesize=5.1 K 2023-10-31 05:54:24,243 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b7e12c6f039ff414ef8eee79c79535bf in 869ms, sequenceid=5, compaction requested=false 2023-10-31 05:54:24,243 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:24,243 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:24,243 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:54:24,625 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/e86ac80eb5054a9b9e44995d26622187 2023-10-31 05:54:24,632 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310314e54fc7a642d43d49ca30e26d049b11e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310314e54fc7a642d43d49ca30e26d049b11e 2023-10-31 05:54:24,634 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/a622f2699c4c4fc99b23c53fed503e57 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/a622f2699c4c4fc99b23c53fed503e57 2023-10-31 05:54:24,638 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/a622f2699c4c4fc99b23c53fed503e57, entries=4, sequenceid=5, filesize=5.4 K 2023-10-31 05:54:24,639 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/b0d609119ea84277bac801323aacb747 2023-10-31 05:54:24,639 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/e86ac80eb5054a9b9e44995d26622187 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/e86ac80eb5054a9b9e44995d26622187 2023-10-31 05:54:24,643 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/2774acb1012f42999a4abecb50e157bb as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/2774acb1012f42999a4abecb50e157bb 2023-10-31 05:54:24,643 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/e86ac80eb5054a9b9e44995d26622187, entries=2, sequenceid=5, filesize=5.1 K 2023-10-31 05:54:24,644 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for eb42a9600adc7511b8ec2d129b0a1882 in 1270ms, sequenceid=5, compaction requested=false 2023-10-31 05:54:24,644 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:24,644 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:24,644 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:54:24,646 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/2774acb1012f42999a4abecb50e157bb, entries=4, sequenceid=5, filesize=5.4 K 2023-10-31 05:54:24,647 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/b0d609119ea84277bac801323aacb747 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/b0d609119ea84277bac801323aacb747 2023-10-31 05:54:24,652 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/b0d609119ea84277bac801323aacb747, entries=2, sequenceid=5, filesize=5.1 K 2023-10-31 05:54:24,652 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f22d093a048d2c7989ada8d66d0a76fb in 1281ms, sequenceid=5, compaction requested=false 2023-10-31 05:54:24,653 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:24,653 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:24,653 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:54:24,653 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:54:24,653 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,653 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-31 05:54:24,653 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-31 05:54:24,654 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,654 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:24,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:24,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:24,655 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:24,655 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:24,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-31 05:54:24,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22695910[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:24,656 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-31 05:54:24,656 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:24,657 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:24,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:24,657 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-31 05:54:24,657 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-31 05:54:24,657 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:24,657 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,657 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:24,658 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,658 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-31 05:54:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:24,658 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:24,658 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-31 05:54:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:24,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-31 05:54:24,661 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-31 05:54:24,661 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:24,661 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:24,661 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-31 05:54:24,661 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:24,662 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:24,662 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:24,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:24,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:24,662 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:24,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:24,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:24,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:24,663 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:24,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:24,664 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,665 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,666 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:24,666 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:24,666 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:24,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-31 05:54:24,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:24,666 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,666 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:24,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:24,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-31 05:54:24,666 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:24,666 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:24,666 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:24,666 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:24,667 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:24,667 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:24,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:24,767 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:24,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:24,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:24,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:24,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:24,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:24,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:24,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-31 05:54:24,780 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-31 05:54:24,780 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:24,780 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-31 05:54:24,780 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-31 05:54:24,781 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:24,781 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:24,781 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:24,781 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:24,782 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:24,782 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:24,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:24,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:24,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:24,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:24,782 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-31 05:54:24,782 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-31 05:54:24,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-31 05:54:24,782 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-31 05:54:24,782 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:24,782 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-31 05:54:24,783 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:24,783 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:24,783 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:54:24,783 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:24,783 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. started... 2023-10-31 05:54:24,783 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:24,783 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. started... 2023-10-31 05:54:24,783 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. started... 2023-10-31 05:54:24,783 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f22d093a048d2c7989ada8d66d0a76fb 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-31 05:54:24,783 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing eb42a9600adc7511b8ec2d129b0a1882 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-31 05:54:24,783 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b7e12c6f039ff414ef8eee79c79535bf 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-31 05:54:24,802 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310316219b08ba5214e99b26cc1e35e30a4ae to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310316219b08ba5214e99b26cc1e35e30a4ae 2023-10-31 05:54:24,802 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310314789d74ddb804183aa48a5973381545f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310314789d74ddb804183aa48a5973381545f 2023-10-31 05:54:25,207 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031f551a2d3e4514b26b0aa311de217e343 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031f551a2d3e4514b26b0aa311de217e343 2023-10-31 05:54:25,213 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/2108c2f536cf47319df4f363d226ebea 2023-10-31 05:54:25,213 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/afbea286f86d4b80bab44278800e282b 2023-10-31 05:54:25,213 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/7a355f9f198d415d998b610b1810291f 2023-10-31 05:54:25,630 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310311ad31dfe379a4bf792bff3f7701b4625 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310311ad31dfe379a4bf792bff3f7701b4625 2023-10-31 05:54:25,635 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310311053c2acbd8744c28857c8a5170bbb16 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310311053c2acbd8744c28857c8a5170bbb16 2023-10-31 05:54:25,635 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031fbf12609cb474507848635f3e40e9421 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031fbf12609cb474507848635f3e40e9421 2023-10-31 05:54:25,637 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/ddafac5cbaab41e7ac9bff616f08a090 2023-10-31 05:54:25,641 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/4e2a6984cb3c4c6da0b331506a2f6e47 2023-10-31 05:54:25,642 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/2108c2f536cf47319df4f363d226ebea as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/2108c2f536cf47319df4f363d226ebea 2023-10-31 05:54:25,645 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/afbea286f86d4b80bab44278800e282b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/afbea286f86d4b80bab44278800e282b 2023-10-31 05:54:25,646 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/2108c2f536cf47319df4f363d226ebea, entries=4, sequenceid=9, filesize=5.4 K 2023-10-31 05:54:25,646 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/ddafac5cbaab41e7ac9bff616f08a090 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/ddafac5cbaab41e7ac9bff616f08a090 2023-10-31 05:54:25,649 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/afbea286f86d4b80bab44278800e282b, entries=4, sequenceid=9, filesize=5.4 K 2023-10-31 05:54:25,649 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/ddafac5cbaab41e7ac9bff616f08a090, entries=2, sequenceid=9, filesize=5.1 K 2023-10-31 05:54:25,650 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/4e2a6984cb3c4c6da0b331506a2f6e47 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/4e2a6984cb3c4c6da0b331506a2f6e47 2023-10-31 05:54:25,650 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for eb42a9600adc7511b8ec2d129b0a1882 in 867ms, sequenceid=9, compaction requested=false 2023-10-31 05:54:25,650 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:25,650 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:25,650 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:54:25,654 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/4e2a6984cb3c4c6da0b331506a2f6e47, entries=2, sequenceid=9, filesize=5.1 K 2023-10-31 05:54:25,654 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b7e12c6f039ff414ef8eee79c79535bf in 871ms, sequenceid=9, compaction requested=false 2023-10-31 05:54:25,654 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:25,654 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:25,654 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:54:26,043 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/97299919220640efbaaae032eff206a1 2023-10-31 05:54:26,056 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/7a355f9f198d415d998b610b1810291f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/7a355f9f198d415d998b610b1810291f 2023-10-31 05:54:26,062 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/7a355f9f198d415d998b610b1810291f, entries=4, sequenceid=9, filesize=5.4 K 2023-10-31 05:54:26,064 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/97299919220640efbaaae032eff206a1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/97299919220640efbaaae032eff206a1 2023-10-31 05:54:26,070 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/97299919220640efbaaae032eff206a1, entries=2, sequenceid=9, filesize=5.1 K 2023-10-31 05:54:26,071 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f22d093a048d2c7989ada8d66d0a76fb in 1288ms, sequenceid=9, compaction requested=false 2023-10-31 05:54:26,071 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:26,071 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:26,071 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:54:26,071 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:54:26,071 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,072 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-31 05:54:26,072 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-31 05:54:26,073 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,073 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:26,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:26,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:26,074 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:26,074 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:26,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:26,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:26,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:26,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:26,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-31 05:54:26,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1277590a[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:26,077 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-31 05:54:26,077 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:26,077 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:26,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:26,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:26,078 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-31 05:54:26,078 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-31 05:54:26,078 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:26,078 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,078 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:26,079 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-31 05:54:26,080 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:26,080 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-31 05:54:26,079 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:26,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:26,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:26,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:26,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:26,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-31 05:54:26,084 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-31 05:54:26,085 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:26,085 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:26,085 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-31 05:54:26,085 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:26,095 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:26,095 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:26,095 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:26,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:26,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:26,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:26,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:26,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:26,096 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:26,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:26,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:26,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:26,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:26,098 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:26,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:26,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,103 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:26,103 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,103 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:26,104 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:26,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:26,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:26,103 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:26,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-31 05:54:26,104 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,104 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:26,104 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:26,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-31 05:54:26,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:26,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:26,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:26,104 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:26,104 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:26,105 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:26,105 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:26,205 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:26,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:26,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:26,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:26,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:26,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:26,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:26,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-31 05:54:26,218 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-31 05:54:26,218 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:26,218 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-31 05:54:26,218 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-31 05:54:26,218 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:26,218 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:26,219 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,219 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:26,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:26,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:26,219 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:26,219 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:26,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:26,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:26,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:26,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:26,220 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-31 05:54:26,220 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-31 05:54:26,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-31 05:54:26,220 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-31 05:54:26,220 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:26,220 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-31 05:54:26,220 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:26,220 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:26,221 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. started... 2023-10-31 05:54:26,221 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:54:26,221 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:26,220 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. started... 2023-10-31 05:54:26,221 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b7e12c6f039ff414ef8eee79c79535bf 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-31 05:54:26,221 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:26,221 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f22d093a048d2c7989ada8d66d0a76fb 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-31 05:54:26,221 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. started... 2023-10-31 05:54:26,221 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing eb42a9600adc7511b8ec2d129b0a1882 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-31 05:54:26,233 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031e8b7131d0e614ceb9b6e097ce224bef3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031e8b7131d0e614ceb9b6e097ce224bef3 2023-10-31 05:54:26,450 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:54:26,603 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-10-31 05:54:26,603 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:54:26,604 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06ab395e to 127.0.0.1:64652 2023-10-31 05:54:26,604 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:54:26,635 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310314d8f55700ece40e982ba0bc138242f13 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310314d8f55700ece40e982ba0bc138242f13 2023-10-31 05:54:26,635 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031f574ec4e23004a7db1656ea9f05e6fd4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031f574ec4e23004a7db1656ea9f05e6fd4 2023-10-31 05:54:26,637 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/a2fb9d8b1f8a40cba28e527b329e2d26 2023-10-31 05:54:27,043 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/667fa68c920b4558a21f704dd9d44415 2023-10-31 05:54:27,044 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/73a7ba34b5a648c08bbb39fde60a690c 2023-10-31 05:54:27,055 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031e47a58814a674a4f812f133b3aa21778 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231031e47a58814a674a4f812f133b3aa21778 2023-10-31 05:54:27,462 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/6c218372c41a45eba43add83f759fd84 2023-10-31 05:54:27,472 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310314e2ee7bef7924f05a5495028f076ea30 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310314e2ee7bef7924f05a5495028f076ea30 2023-10-31 05:54:27,472 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031b4f03822353b47688d156c2484621591 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031b4f03822353b47688d156c2484621591 2023-10-31 05:54:27,473 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/a2fb9d8b1f8a40cba28e527b329e2d26 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/a2fb9d8b1f8a40cba28e527b329e2d26 2023-10-31 05:54:27,478 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/a2fb9d8b1f8a40cba28e527b329e2d26, entries=4, sequenceid=13, filesize=5.4 K 2023-10-31 05:54:27,479 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/6c218372c41a45eba43add83f759fd84 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/6c218372c41a45eba43add83f759fd84 2023-10-31 05:54:27,482 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/6c218372c41a45eba43add83f759fd84, entries=2, sequenceid=13, filesize=5.1 K 2023-10-31 05:54:27,483 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b7e12c6f039ff414ef8eee79c79535bf in 1262ms, sequenceid=13, compaction requested=true 2023-10-31 05:54:27,483 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:27,483 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:27,484 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:54:27,878 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/997efb8497c94665857d3ef62b776dc2 2023-10-31 05:54:27,878 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/5c9df285c28f416ba2805ae46ec55263 2023-10-31 05:54:27,890 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/73a7ba34b5a648c08bbb39fde60a690c as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/73a7ba34b5a648c08bbb39fde60a690c 2023-10-31 05:54:27,890 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/667fa68c920b4558a21f704dd9d44415 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/667fa68c920b4558a21f704dd9d44415 2023-10-31 05:54:27,895 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/73a7ba34b5a648c08bbb39fde60a690c, entries=4, sequenceid=13, filesize=5.4 K 2023-10-31 05:54:27,895 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/667fa68c920b4558a21f704dd9d44415, entries=4, sequenceid=13, filesize=5.4 K 2023-10-31 05:54:27,895 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/997efb8497c94665857d3ef62b776dc2 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/997efb8497c94665857d3ef62b776dc2 2023-10-31 05:54:27,896 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/5c9df285c28f416ba2805ae46ec55263 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/5c9df285c28f416ba2805ae46ec55263 2023-10-31 05:54:27,902 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/997efb8497c94665857d3ef62b776dc2, entries=2, sequenceid=13, filesize=5.1 K 2023-10-31 05:54:27,903 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/5c9df285c28f416ba2805ae46ec55263, entries=2, sequenceid=13, filesize=5.1 K 2023-10-31 05:54:27,903 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f22d093a048d2c7989ada8d66d0a76fb in 1682ms, sequenceid=13, compaction requested=true 2023-10-31 05:54:27,903 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for eb42a9600adc7511b8ec2d129b0a1882 in 1682ms, sequenceid=13, compaction requested=true 2023-10-31 05:54:27,903 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:27,904 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:27,904 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:27,904 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:27,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:54:27,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:54:27,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:54:27,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-31 05:54:27,904 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-31 05:54:27,906 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,906 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:27,907 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:27,907 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:27,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-31 05:54:27,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d5c4f61[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:27,909 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-31 05:54:27,909 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:27,910 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:27,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:27,910 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,910 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:27,910 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-31 05:54:27,910 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-31 05:54:27,910 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:27,911 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,911 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-31 05:54:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:27,911 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:27,912 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-31 05:54:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:27,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-31 05:54:27,915 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-31 05:54:27,915 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:27,915 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:27,915 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-31 05:54:27,915 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:27,916 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:27,916 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:27,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:27,916 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:27,917 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,918 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,921 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,921 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:27,921 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:27,921 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:27,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-31 05:54:27,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:27,921 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:27,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-31 05:54:27,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:27,921 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:27,921 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:27,921 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:27,921 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:27,921 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:27,921 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:27,922 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:27,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:28,022 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:28,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:28,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:28,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:28,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:28,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:28,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:28,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-31 05:54:28,035 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-31 05:54:28,035 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:28,035 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-31 05:54:28,035 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-31 05:54:28,035 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:28,036 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:28,036 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:28,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:28,036 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:28,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:28,037 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:28,037 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:28,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:28,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:28,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:28,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:28,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-31 05:54:28,037 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-31 05:54:28,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-31 05:54:28,038 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-31 05:54:28,038 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:28,038 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-31 05:54:28,038 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:28,038 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:28,038 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. started... 2023-10-31 05:54:28,038 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. started... 2023-10-31 05:54:28,038 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:54:28,038 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:28,038 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:28,038 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f22d093a048d2c7989ada8d66d0a76fb 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-31 05:54:28,038 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b7e12c6f039ff414ef8eee79c79535bf 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-31 05:54:28,038 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. started... 2023-10-31 05:54:28,038 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing eb42a9600adc7511b8ec2d129b0a1882 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-31 05:54:28,461 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031e21644beb17b4d7c976028bcb5a65f95 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031e21644beb17b4d7c976028bcb5a65f95 2023-10-31 05:54:28,461 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031776f3a1986f648c9a37bc1c834baa568 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031776f3a1986f648c9a37bc1c834baa568 2023-10-31 05:54:28,461 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310312afb309d45a54170b221abc86bcc0174 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310312afb309d45a54170b221abc86bcc0174 2023-10-31 05:54:28,876 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/d0d514f5e62f4c999dee316ccfc18d3c 2023-10-31 05:54:28,876 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/fd84e1bae15d49e4817ad9d83202640c 2023-10-31 05:54:28,877 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/00fd9f6249a0470392d40c12c47108bb 2023-10-31 05:54:29,305 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310315a32605e90f9431484382450f3b76fae to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310315a32605e90f9431484382450f3b76fae 2023-10-31 05:54:29,309 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310314309da408979412ba8567234dc81c597 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310314309da408979412ba8567234dc81c597 2023-10-31 05:54:29,309 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310312ba9bc0058294c8f8531a7809dee9861 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310312ba9bc0058294c8f8531a7809dee9861 2023-10-31 05:54:29,312 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/ee997ecbcaab423fae024542830ba6a0 2023-10-31 05:54:29,316 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/d0d514f5e62f4c999dee316ccfc18d3c as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d0d514f5e62f4c999dee316ccfc18d3c 2023-10-31 05:54:29,319 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d0d514f5e62f4c999dee316ccfc18d3c, entries=4, sequenceid=17, filesize=5.4 K 2023-10-31 05:54:29,320 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/ee997ecbcaab423fae024542830ba6a0 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/ee997ecbcaab423fae024542830ba6a0 2023-10-31 05:54:29,323 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/ee997ecbcaab423fae024542830ba6a0, entries=2, sequenceid=17, filesize=5.1 K 2023-10-31 05:54:29,324 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f22d093a048d2c7989ada8d66d0a76fb in 1286ms, sequenceid=17, compaction requested=true 2023-10-31 05:54:29,324 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:29,324 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:29,324 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:54:29,716 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/bba13718c93844f2abd2fe349febfec3 2023-10-31 05:54:29,716 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/dfe68341782842c79beeb904a2e7fefb 2023-10-31 05:54:29,728 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/00fd9f6249a0470392d40c12c47108bb as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/00fd9f6249a0470392d40c12c47108bb 2023-10-31 05:54:29,728 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/fd84e1bae15d49e4817ad9d83202640c as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/fd84e1bae15d49e4817ad9d83202640c 2023-10-31 05:54:29,731 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/00fd9f6249a0470392d40c12c47108bb, entries=4, sequenceid=17, filesize=5.4 K 2023-10-31 05:54:29,732 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/fd84e1bae15d49e4817ad9d83202640c, entries=4, sequenceid=17, filesize=5.4 K 2023-10-31 05:54:29,732 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/bba13718c93844f2abd2fe349febfec3 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/bba13718c93844f2abd2fe349febfec3 2023-10-31 05:54:29,732 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/dfe68341782842c79beeb904a2e7fefb as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/dfe68341782842c79beeb904a2e7fefb 2023-10-31 05:54:29,736 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/bba13718c93844f2abd2fe349febfec3, entries=2, sequenceid=17, filesize=5.1 K 2023-10-31 05:54:29,736 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/dfe68341782842c79beeb904a2e7fefb, entries=2, sequenceid=17, filesize=5.1 K 2023-10-31 05:54:29,737 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b7e12c6f039ff414ef8eee79c79535bf in 1699ms, sequenceid=17, compaction requested=true 2023-10-31 05:54:29,737 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for eb42a9600adc7511b8ec2d129b0a1882 in 1699ms, sequenceid=17, compaction requested=true 2023-10-31 05:54:29,737 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:29,737 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:29,737 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:29,737 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:29,737 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:54:29,737 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:54:29,737 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:54:29,737 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,737 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-31 05:54:29,737 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-31 05:54:29,738 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,738 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:29,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:29,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:29,738 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:29,738 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:29,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:29,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:29,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:29,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:29,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-31 05:54:29,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38e4439b[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:29,740 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-31 05:54:29,740 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:29,740 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:29,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:29,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:29,740 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-31 05:54:29,740 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-31 05:54:29,740 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,740 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:29,740 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:29,741 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-31 05:54:29,741 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,741 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:29,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:29,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:29,741 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-31 05:54:29,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:29,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:29,743 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-31 05:54:29,743 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:29,743 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:29,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-31 05:54:29,743 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-31 05:54:29,743 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:29,744 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:29,744 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:29,744 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:29,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:29,744 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,745 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:29,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:29,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:29,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-31 05:54:29,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:29,747 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:29,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:29,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:29,747 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:29,847 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:29,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:29,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-31 05:54:29,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698731669864 (current time:1698731669864). 2023-10-31 05:54:29,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-31 05:54:29,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] zookeeper.ReadOnlyZKClient(139): Connect 0x5efba736 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:54:29,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d8de513, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:54:29,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:54:29,878 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:54:29,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5efba736 to 127.0.0.1:64652 2023-10-31 05:54:29,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:54:29,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-31 05:54:29,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-31 05:54:29,891 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot, current working dir path: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp/snaptb-1698731669850 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-31 05:54:29,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-31 05:54:29,900 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-31 05:54:29,901 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698732269900 2023-10-31 05:54:29,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-31 05:54:29,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1698731669850 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-31 05:54:29,902 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-31 05:54:29,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-31 05:54:29,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-10-31 05:54:29,904 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-31 05:54:29,904 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1698732269904 2023-10-31 05:54:29,907 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:29,907 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-31 05:54:30,007 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-31 05:54:30,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-31 05:54:30,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-31 05:54:30,016 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-31 05:54:30,216 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-31 05:54:30,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-31 05:54:30,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-31 05:54:30,219 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-31 05:54:30,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1698731669850 2023-10-31 05:54:30,322 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1698731669850' 2023-10-31 05:54:30,322 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-31 05:54:30,322 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1698731669850' starting 'acquire' 2023-10-31 05:54:30,322 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1698731669850', kicking off acquire phase on members. 2023-10-31 05:54:30,323 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698731669850 2023-10-31 05:54:30,323 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1698731669850 2023-10-31 05:54:30,325 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,325 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-31 05:54:30,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-31 05:54:30,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-31 05:54:30,325 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,325 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:30,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1698731669850 2023-10-31 05:54:30,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698731669850 2023-10-31 05:54:30,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-10-31 05:54:30,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1698731669850 2023-10-31 05:54:30,326 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1698731669850 from table testCompactionWithHFileLink type FLUSH 2023-10-31 05:54:30,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1698731669850 2023-10-31 05:54:30,328 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1698731669850' with timeout 300000ms 2023-10-31 05:54:30,328 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-31 05:54:30,328 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1698731669850' starting 'acquire' stage 2023-10-31 05:54:30,328 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1698731669850' locally acquired 2023-10-31 05:54:30,328 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (snaptb-1698731669850) in zk 2023-10-31 05:54:30,336 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1698731669850 2023-10-31 05:54:30,336 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-31 05:54:30,337 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698731669850 2023-10-31 05:54:30,337 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1698731669850' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:30,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698731669850 2023-10-31 05:54:30,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:30,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'snaptb-1698731669850' on coordinator 2023-10-31 05:54:30,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50ad2c4e[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:30,339 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1698731669850' starting 'in-barrier' execution. 2023-10-31 05:54:30,339 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1698731669850 2023-10-31 05:54:30,339 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698731669850 2023-10-31 05:54:30,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1698731669850 2023-10-31 05:54:30,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1698731669850 2023-10-31 05:54:30,340 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1698731669850' received 'reached' from coordinator. 2023-10-31 05:54:30,340 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,340 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:30,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:30,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:30,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:30,341 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-10-31 05:54:30,341 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-31 05:54:30,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. started... 2023-10-31 05:54:30,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. started... 2023-10-31 05:54:30,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. started... 2023-10-31 05:54:30,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:30,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:30,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:30,342 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.' region-info for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,342 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.' region-info for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,342 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.' region-info for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,348 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-31 05:54:30,348 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-31 05:54:30,348 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-31 05:54:30,352 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/9287dde0b3254eabb55ecc6bdad2e400, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/afbea286f86d4b80bab44278800e282b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/a2fb9d8b1f8a40cba28e527b329e2d26, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/fd84e1bae15d49e4817ad9d83202640c] hfiles 2023-10-31 05:54:30,352 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/2774acb1012f42999a4abecb50e157bb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/7a355f9f198d415d998b610b1810291f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/73a7ba34b5a648c08bbb39fde60a690c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d0d514f5e62f4c999dee316ccfc18d3c] hfiles 2023-10-31 05:54:30,352 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/2774acb1012f42999a4abecb50e157bb for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,352 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/a622f2699c4c4fc99b23c53fed503e57, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/2108c2f536cf47319df4f363d226ebea, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/667fa68c920b4558a21f704dd9d44415, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/00fd9f6249a0470392d40c12c47108bb] hfiles 2023-10-31 05:54:30,352 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/9287dde0b3254eabb55ecc6bdad2e400 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,352 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/a622f2699c4c4fc99b23c53fed503e57 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/7a355f9f198d415d998b610b1810291f for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/73a7ba34b5a648c08bbb39fde60a690c for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d0d514f5e62f4c999dee316ccfc18d3c for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/2108c2f536cf47319df4f363d226ebea for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/afbea286f86d4b80bab44278800e282b for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/a2fb9d8b1f8a40cba28e527b329e2d26 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/fd84e1bae15d49e4817ad9d83202640c for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/b0d609119ea84277bac801323aacb747, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/97299919220640efbaaae032eff206a1, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/997efb8497c94665857d3ef62b776dc2, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/ee997ecbcaab423fae024542830ba6a0] hfiles 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/b0d609119ea84277bac801323aacb747 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/97299919220640efbaaae032eff206a1 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/997efb8497c94665857d3ef62b776dc2 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/667fa68c920b4558a21f704dd9d44415 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/ee997ecbcaab423fae024542830ba6a0 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/85100bf9ebc14d4eb9777c58d74f5795, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/4e2a6984cb3c4c6da0b331506a2f6e47, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/6c218372c41a45eba43add83f759fd84, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/dfe68341782842c79beeb904a2e7fefb] hfiles 2023-10-31 05:54:30,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/00fd9f6249a0470392d40c12c47108bb for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,357 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/85100bf9ebc14d4eb9777c58d74f5795 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,357 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/4e2a6984cb3c4c6da0b331506a2f6e47 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,357 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/6c218372c41a45eba43add83f759fd84 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,357 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/dfe68341782842c79beeb904a2e7fefb for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,357 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/e86ac80eb5054a9b9e44995d26622187, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/ddafac5cbaab41e7ac9bff616f08a090, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/5c9df285c28f416ba2805ae46ec55263, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/bba13718c93844f2abd2fe349febfec3] hfiles 2023-10-31 05:54:30,357 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/e86ac80eb5054a9b9e44995d26622187 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,357 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/ddafac5cbaab41e7ac9bff616f08a090 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,357 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/5c9df285c28f416ba2805ae46ec55263 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,357 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/bba13718c93844f2abd2fe349febfec3 for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,519 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-31 05:54:30,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-31 05:54:30,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-31 05:54:30,520 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-31 05:54:30,766 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. completed. 2023-10-31 05:54:30,766 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:30,766 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. completed. 2023-10-31 05:54:30,766 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:30,767 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. completed. 2023-10-31 05:54:30,767 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:30,767 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-10-31 05:54:30,768 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-10-31 05:54:30,768 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-10-31 05:54:30,768 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-10-31 05:54:30,768 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,768 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1698731669850' locally completed 2023-10-31 05:54:30,768 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1698731669850' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:30,771 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,771 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1698731669850' has notified controller of completion 2023-10-31 05:54:30,771 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:30,771 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1698731669850' completed. 2023-10-31 05:54:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-31 05:54:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:30,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698731669850 2023-10-31 05:54:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698731669850 2023-10-31 05:54:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1698731669850' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:30,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'snaptb-1698731669850', counting down latch. Waiting for 0 more 2023-10-31 05:54:30,776 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1698731669850' execution completed 2023-10-31 05:54:30,776 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:30,776 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:30,776 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1698731669850 2023-10-31 05:54:30,776 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1698731669850including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-31 05:54:30,777 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698731669850 2023-10-31 05:54:30,777 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698731669850 2023-10-31 05:54:30,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1698731669850 2023-10-31 05:54:30,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698731669850 2023-10-31 05:54:30,777 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-31 05:54:30,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1698731669850 2023-10-31 05:54:30,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:30,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-31 05:54:30,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-31 05:54:30,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-31 05:54:30,777 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:30,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698731669850 2023-10-31 05:54:30,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698731669850 2023-10-31 05:54:30,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:30,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698731669850 2023-10-31 05:54:30,778 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:30,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698731669850 2023-10-31 05:54:30,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,779 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,779 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698731669850 2023-10-31 05:54:30,779 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-31 05:54:30,779 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698731669850 2023-10-31 05:54:30,780 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:30,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1698731669850 because node does not exist (not an error) 2023-10-31 05:54:30,779 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-31 05:54:30,780 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1698731669850 2023-10-31 05:54:30,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698731669850/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:30,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698731669850 2023-10-31 05:54:30,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698731669850 2023-10-31 05:54:30,780 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698731669850 2023-10-31 05:54:30,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-31 05:54:30,780 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-10-31 05:54:30,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-31 05:54:30,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1698731669850 2023-10-31 05:54:30,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-31 05:54:30,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-31 05:54:30,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310314d8f55700ece40e982ba0bc138242f13, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031600b2f80e18f4286b54c1b0be5c7ae4f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310316219b08ba5214e99b26cc1e35e30a4ae, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031776f3a1986f648c9a37bc1c834baa568, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310312afb309d45a54170b221abc86bcc0174, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310314789d74ddb804183aa48a5973381545f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310314f9e0582898040b697e45d0aee7063da, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031e8b7131d0e614ceb9b6e097ce224bef3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023103197580ffd55b3462f885c5e51c2f01fb0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031e21644beb17b4d7c976028bcb5a65f95, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031f551a2d3e4514b26b0aa311de217e343, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031f574ec4e23004a7db1656ea9f05e6fd4] mob files 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310314d8f55700ece40e982ba0bc138242f13 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031600b2f80e18f4286b54c1b0be5c7ae4f 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310316219b08ba5214e99b26cc1e35e30a4ae 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031776f3a1986f648c9a37bc1c834baa568 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310312afb309d45a54170b221abc86bcc0174 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310314789d74ddb804183aa48a5973381545f 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310314f9e0582898040b697e45d0aee7063da 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031e8b7131d0e614ceb9b6e097ce224bef3 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023103197580ffd55b3462f885c5e51c2f01fb0 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031e21644beb17b4d7c976028bcb5a65f95 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031f551a2d3e4514b26b0aa311de217e343 2023-10-31 05:54:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031f574ec4e23004a7db1656ea9f05e6fd4 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310311ad31dfe379a4bf792bff3f7701b4625, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231031298690a82a0a4e70ba6a01d6636e82d8, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310314309da408979412ba8567234dc81c597, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310314e2ee7bef7924f05a5495028f076ea30, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310311053c2acbd8744c28857c8a5170bbb16, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310312ba9bc0058294c8f8531a7809dee9861, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310313f598e186dd04cf1805d8c07f321b188, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231031e47a58814a674a4f812f133b3aa21778, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310314e54fc7a642d43d49ca30e26d049b11e, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310315a32605e90f9431484382450f3b76fae, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031b4f03822353b47688d156c2484621591, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031fbf12609cb474507848635f3e40e9421] mob files 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310311ad31dfe379a4bf792bff3f7701b4625 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231031298690a82a0a4e70ba6a01d6636e82d8 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310314309da408979412ba8567234dc81c597 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310314e2ee7bef7924f05a5495028f076ea30 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310311053c2acbd8744c28857c8a5170bbb16 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310312ba9bc0058294c8f8531a7809dee9861 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310313f598e186dd04cf1805d8c07f321b188 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231031e47a58814a674a4f812f133b3aa21778 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310314e54fc7a642d43d49ca30e26d049b11e 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310315a32605e90f9431484382450f3b76fae 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031b4f03822353b47688d156c2484621591 2023-10-31 05:54:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031fbf12609cb474507848635f3e40e9421 2023-10-31 05:54:31,020 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-31 05:54:31,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-31 05:54:31,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-31 05:54:31,023 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-31 05:54:31,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1698731669850 2023-10-31 05:54:31,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp/snaptb-1698731669850 2023-10-31 05:54:31,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp/snaptb-1698731669850 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/snaptb-1698731669850 2023-10-31 05:54:31,645 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1698731669850 of table testCompactionWithHFileLink completed 2023-10-31 05:54:31,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp/snaptb-1698731669850 2023-10-31 05:54:31,646 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp/snaptb-1698731669850 2023-10-31 05:54:31,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1698731669850 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698731669901Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1698731671188 (+1287 ms)Consolidate snapshot: snaptb-1698731669850 at 1698731671188Loading Region manifests for snaptb-1698731669850 at 1698731671188Writing data manifest for snaptb-1698731669850 at 1698731671203 (+15 ms)Verifying snapshot: snaptb-1698731669850 at 1698731671614 (+411 ms)Snapshot snaptb-1698731669850 of table testCompactionWithHFileLink completed at 1698731671645 (+31 ms) 2023-10-31 05:54:31,647 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-31 05:54:31,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7450 sec 2023-10-31 05:54:32,024 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-31 05:54:32,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-31 05:54:32,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-31 05:54:32,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:32,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:32,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-31 05:54:32,066 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-31 05:54:32,066 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:32,066 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-31 05:54:32,066 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-31 05:54:32,066 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:32,066 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:32,067 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:32,067 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:32,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:32,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:32,068 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:32,068 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:32,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:32,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:32,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:32,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:32,069 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-31 05:54:32,069 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-31 05:54:32,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-31 05:54:32,069 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-31 05:54:32,069 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:32,069 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-31 05:54:32,069 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:32,069 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:54:32,069 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:32,069 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:32,069 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:32,069 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. started... 2023-10-31 05:54:32,069 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. started... 2023-10-31 05:54:32,069 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. started... 2023-10-31 05:54:32,069 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing eb42a9600adc7511b8ec2d129b0a1882 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-31 05:54:32,070 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b7e12c6f039ff414ef8eee79c79535bf 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-31 05:54:32,070 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f22d093a048d2c7989ada8d66d0a76fb 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-31 05:54:32,913 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/7a3f2fc62aa7460f8d7b9cebf413b562 2023-10-31 05:54:32,917 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a3f2fc62aa7460f8d7b9cebf413b562 2023-10-31 05:54:32,921 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/06a4b41719ba4ea982ef7947551dc9a3 2023-10-31 05:54:32,925 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/512c8eebd25c489aa2c6dc5fb1cd5ee9 2023-10-31 05:54:32,926 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06a4b41719ba4ea982ef7947551dc9a3 2023-10-31 05:54:32,932 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 512c8eebd25c489aa2c6dc5fb1cd5ee9 2023-10-31 05:54:33,348 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/cb1a4b02f2dd46de9649abb92f4dfa9e 2023-10-31 05:54:33,354 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb1a4b02f2dd46de9649abb92f4dfa9e 2023-10-31 05:54:33,355 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/7a3f2fc62aa7460f8d7b9cebf413b562 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/7a3f2fc62aa7460f8d7b9cebf413b562 2023-10-31 05:54:33,359 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a3f2fc62aa7460f8d7b9cebf413b562 2023-10-31 05:54:33,359 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/7a3f2fc62aa7460f8d7b9cebf413b562, entries=3, sequenceid=24, filesize=5.0 K 2023-10-31 05:54:33,360 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/cb1a4b02f2dd46de9649abb92f4dfa9e as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/cb1a4b02f2dd46de9649abb92f4dfa9e 2023-10-31 05:54:33,365 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb1a4b02f2dd46de9649abb92f4dfa9e 2023-10-31 05:54:33,365 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/cb1a4b02f2dd46de9649abb92f4dfa9e, entries=1, sequenceid=24, filesize=5.0 K 2023-10-31 05:54:33,366 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b7e12c6f039ff414ef8eee79c79535bf in 1296ms, sequenceid=24, compaction requested=true 2023-10-31 05:54:33,366 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:33,366 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:33,366 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:54:33,371 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/82858b009c3349edad42f5c3b443bf2b 2023-10-31 05:54:33,375 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82858b009c3349edad42f5c3b443bf2b 2023-10-31 05:54:33,376 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/06a4b41719ba4ea982ef7947551dc9a3 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/06a4b41719ba4ea982ef7947551dc9a3 2023-10-31 05:54:33,380 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06a4b41719ba4ea982ef7947551dc9a3 2023-10-31 05:54:33,380 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/06a4b41719ba4ea982ef7947551dc9a3, entries=3, sequenceid=24, filesize=5.0 K 2023-10-31 05:54:33,381 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/82858b009c3349edad42f5c3b443bf2b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/82858b009c3349edad42f5c3b443bf2b 2023-10-31 05:54:33,386 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82858b009c3349edad42f5c3b443bf2b 2023-10-31 05:54:33,387 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/82858b009c3349edad42f5c3b443bf2b, entries=1, sequenceid=24, filesize=5.0 K 2023-10-31 05:54:33,387 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for eb42a9600adc7511b8ec2d129b0a1882 in 1318ms, sequenceid=24, compaction requested=true 2023-10-31 05:54:33,387 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:33,388 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:33,388 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:54:33,771 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/00f753ae1aa141fba8d5ee130b17ba89 2023-10-31 05:54:33,777 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00f753ae1aa141fba8d5ee130b17ba89 2023-10-31 05:54:33,777 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/512c8eebd25c489aa2c6dc5fb1cd5ee9 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/512c8eebd25c489aa2c6dc5fb1cd5ee9 2023-10-31 05:54:33,782 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 512c8eebd25c489aa2c6dc5fb1cd5ee9 2023-10-31 05:54:33,782 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/512c8eebd25c489aa2c6dc5fb1cd5ee9, entries=3, sequenceid=24, filesize=5.0 K 2023-10-31 05:54:33,783 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/00f753ae1aa141fba8d5ee130b17ba89 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/00f753ae1aa141fba8d5ee130b17ba89 2023-10-31 05:54:33,788 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00f753ae1aa141fba8d5ee130b17ba89 2023-10-31 05:54:33,788 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/00f753ae1aa141fba8d5ee130b17ba89, entries=1, sequenceid=24, filesize=5.0 K 2023-10-31 05:54:33,789 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f22d093a048d2c7989ada8d66d0a76fb in 1719ms, sequenceid=24, compaction requested=true 2023-10-31 05:54:33,789 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:33,789 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:33,789 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:54:33,789 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:54:33,789 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,789 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-31 05:54:33,789 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-31 05:54:33,791 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:33,791 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:33,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:33,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:33,792 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:33,792 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:33,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:33,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:33,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:33,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-31 05:54:33,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@783a9058[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:33,793 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-31 05:54:33,793 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:33,794 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:33,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:33,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:33,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-31 05:54:33,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-31 05:54:33,794 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:33,794 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,794 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:33,795 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,795 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-31 05:54:33,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:33,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:33,795 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:33,795 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-31 05:54:33,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:33,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:33,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:33,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:33,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:33,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:33,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-31 05:54:33,798 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-31 05:54:33,798 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:33,798 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:33,798 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-31 05:54:33,798 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:33,799 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:33,799 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:33,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:33,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:33,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:33,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:33,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:33,799 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:33,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:33,800 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:33,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:33,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:33,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:33,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:33,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:33,801 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:33,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-31 05:54:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,802 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,802 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:33,802 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-31 05:54:33,802 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:33,802 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:33,802 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:33,802 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:33,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-31 05:54:33,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:33,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-31 05:54:33,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:33,803 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:33,803 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-31 05:54:33,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:33,803 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-31 05:54:33,803 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:33,803 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:33,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:33,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:33,903 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:33,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:33,905 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:33,905 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): f22d093a048d2c7989ada8d66d0a76fb/family1 is initiating major compaction (all files) 2023-10-31 05:54:33,906 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:33,906 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:33,906 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of f22d093a048d2c7989ada8d66d0a76fb/family1 in testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:33,906 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/2774acb1012f42999a4abecb50e157bb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/7a355f9f198d415d998b610b1810291f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/73a7ba34b5a648c08bbb39fde60a690c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d0d514f5e62f4c999dee316ccfc18d3c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/512c8eebd25c489aa2c6dc5fb1cd5ee9] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp, totalSize=26.7 K 2023-10-31 05:54:33,907 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 2774acb1012f42999a4abecb50e157bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663361 2023-10-31 05:54:33,908 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 7a355f9f198d415d998b610b1810291f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664770 2023-10-31 05:54:33,908 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 73a7ba34b5a648c08bbb39fde60a690c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666209 2023-10-31 05:54:33,909 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting d0d514f5e62f4c999dee316ccfc18d3c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668027 2023-10-31 05:54:33,909 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 512c8eebd25c489aa2c6dc5fb1cd5ee9, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-31 05:54:33,926 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): f22d093a048d2c7989ada8d66d0a76fb#family1#compaction#107 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:34,337 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231031c7caa8092df94cddbe001e2bec448343_del 2023-10-31 05:54:34,337 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031c7caa8092df94cddbe001e2bec448343_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031c7caa8092df94cddbe001e2bec448343_del 2023-10-31 05:54:35,163 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d68654e3831c434b8e49350ffde7a7d2 2023-10-31 05:54:35,164 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/d68654e3831c434b8e49350ffde7a7d2 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d68654e3831c434b8e49350ffde7a7d2 2023-10-31 05:54:35,170 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d68654e3831c434b8e49350ffde7a7d2 2023-10-31 05:54:35,172 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f22d093a048d2c7989ada8d66d0a76fb/family1 of f22d093a048d2c7989ada8d66d0a76fb into d68654e3831c434b8e49350ffde7a7d2(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:54:35,172 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:35,172 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:35,172 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): f22d093a048d2c7989ada8d66d0a76fb/family2 is initiating major compaction (all files) 2023-10-31 05:54:35,172 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:35,172 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:35,173 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of f22d093a048d2c7989ada8d66d0a76fb/family2 in testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:35,173 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/b0d609119ea84277bac801323aacb747, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/97299919220640efbaaae032eff206a1, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/997efb8497c94665857d3ef62b776dc2, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/ee997ecbcaab423fae024542830ba6a0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/00f753ae1aa141fba8d5ee130b17ba89] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp, totalSize=25.4 K 2023-10-31 05:54:35,173 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting b0d609119ea84277bac801323aacb747, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663361 2023-10-31 05:54:35,174 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 97299919220640efbaaae032eff206a1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664770 2023-10-31 05:54:35,174 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 997efb8497c94665857d3ef62b776dc2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666209 2023-10-31 05:54:35,175 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting ee997ecbcaab423fae024542830ba6a0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668027 2023-10-31 05:54:35,175 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 00f753ae1aa141fba8d5ee130b17ba89, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-31 05:54:35,192 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): f22d093a048d2c7989ada8d66d0a76fb#family2#compaction#108 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:35,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/2774acb1012f42999a4abecb50e157bb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/7a355f9f198d415d998b610b1810291f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/73a7ba34b5a648c08bbb39fde60a690c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d0d514f5e62f4c999dee316ccfc18d3c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/512c8eebd25c489aa2c6dc5fb1cd5ee9] to archive 2023-10-31 05:54:35,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:35,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/2774acb1012f42999a4abecb50e157bb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/2774acb1012f42999a4abecb50e157bb 2023-10-31 05:54:35,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/7a355f9f198d415d998b610b1810291f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/7a355f9f198d415d998b610b1810291f 2023-10-31 05:54:35,215 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/73a7ba34b5a648c08bbb39fde60a690c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/73a7ba34b5a648c08bbb39fde60a690c 2023-10-31 05:54:35,217 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d0d514f5e62f4c999dee316ccfc18d3c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d0d514f5e62f4c999dee316ccfc18d3c 2023-10-31 05:54:35,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/512c8eebd25c489aa2c6dc5fb1cd5ee9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/512c8eebd25c489aa2c6dc5fb1cd5ee9 2023-10-31 05:54:35,610 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231031faf98948ede5471985617e6703cb4342_del 2023-10-31 05:54:35,611 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031faf98948ede5471985617e6703cb4342_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031faf98948ede5471985617e6703cb4342_del 2023-10-31 05:54:36,439 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 520226455aee4b4c8645a1493a3684f7 2023-10-31 05:54:36,441 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/520226455aee4b4c8645a1493a3684f7 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/520226455aee4b4c8645a1493a3684f7 2023-10-31 05:54:36,446 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 520226455aee4b4c8645a1493a3684f7 2023-10-31 05:54:36,447 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f22d093a048d2c7989ada8d66d0a76fb/family2 of f22d093a048d2c7989ada8d66d0a76fb into 520226455aee4b4c8645a1493a3684f7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:54:36,447 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:36,447 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:36,447 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): b7e12c6f039ff414ef8eee79c79535bf/family1 is initiating major compaction (all files) 2023-10-31 05:54:36,447 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:36,448 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:36,448 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of b7e12c6f039ff414ef8eee79c79535bf/family1 in testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:36,448 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/9287dde0b3254eabb55ecc6bdad2e400, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/afbea286f86d4b80bab44278800e282b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/a2fb9d8b1f8a40cba28e527b329e2d26, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/fd84e1bae15d49e4817ad9d83202640c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/7a3f2fc62aa7460f8d7b9cebf413b562] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp, totalSize=26.7 K 2023-10-31 05:54:36,448 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 9287dde0b3254eabb55ecc6bdad2e400, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663363 2023-10-31 05:54:36,449 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting afbea286f86d4b80bab44278800e282b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664771 2023-10-31 05:54:36,449 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting a2fb9d8b1f8a40cba28e527b329e2d26, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666210 2023-10-31 05:54:36,450 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting fd84e1bae15d49e4817ad9d83202640c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668028 2023-10-31 05:54:36,450 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 7a3f2fc62aa7460f8d7b9cebf413b562, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-31 05:54:36,459 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): b7e12c6f039ff414ef8eee79c79535bf#family1#compaction#109 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:36,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/b0d609119ea84277bac801323aacb747, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/97299919220640efbaaae032eff206a1, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/997efb8497c94665857d3ef62b776dc2, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/ee997ecbcaab423fae024542830ba6a0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/00f753ae1aa141fba8d5ee130b17ba89] to archive 2023-10-31 05:54:36,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:36,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/b0d609119ea84277bac801323aacb747 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/b0d609119ea84277bac801323aacb747 2023-10-31 05:54:36,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/97299919220640efbaaae032eff206a1 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/97299919220640efbaaae032eff206a1 2023-10-31 05:54:36,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/997efb8497c94665857d3ef62b776dc2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/997efb8497c94665857d3ef62b776dc2 2023-10-31 05:54:36,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/ee997ecbcaab423fae024542830ba6a0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/ee997ecbcaab423fae024542830ba6a0 2023-10-31 05:54:36,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/00f753ae1aa141fba8d5ee130b17ba89 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/00f753ae1aa141fba8d5ee130b17ba89 2023-10-31 05:54:36,869 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310311b02ac41d08742828a769530ac80ecc3_del 2023-10-31 05:54:36,870 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310311b02ac41d08742828a769530ac80ecc3_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310311b02ac41d08742828a769530ac80ecc3_del 2023-10-31 05:54:37,699 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e87f007eb054a72b68660c985cc5a2b 2023-10-31 05:54:37,701 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/0e87f007eb054a72b68660c985cc5a2b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/0e87f007eb054a72b68660c985cc5a2b 2023-10-31 05:54:37,708 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e87f007eb054a72b68660c985cc5a2b 2023-10-31 05:54:37,709 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b7e12c6f039ff414ef8eee79c79535bf/family1 of b7e12c6f039ff414ef8eee79c79535bf into 0e87f007eb054a72b68660c985cc5a2b(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:54:37,709 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:37,709 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:37,709 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): b7e12c6f039ff414ef8eee79c79535bf/family2 is initiating major compaction (all files) 2023-10-31 05:54:37,709 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:37,710 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:37,710 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of b7e12c6f039ff414ef8eee79c79535bf/family2 in testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:37,710 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/85100bf9ebc14d4eb9777c58d74f5795, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/4e2a6984cb3c4c6da0b331506a2f6e47, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/6c218372c41a45eba43add83f759fd84, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/dfe68341782842c79beeb904a2e7fefb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/cb1a4b02f2dd46de9649abb92f4dfa9e] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp, totalSize=25.4 K 2023-10-31 05:54:37,710 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 85100bf9ebc14d4eb9777c58d74f5795, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663363 2023-10-31 05:54:37,711 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 4e2a6984cb3c4c6da0b331506a2f6e47, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664771 2023-10-31 05:54:37,712 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 6c218372c41a45eba43add83f759fd84, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666210 2023-10-31 05:54:37,712 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting dfe68341782842c79beeb904a2e7fefb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668028 2023-10-31 05:54:37,713 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting cb1a4b02f2dd46de9649abb92f4dfa9e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-31 05:54:37,729 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): b7e12c6f039ff414ef8eee79c79535bf#family2#compaction#110 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:37,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/9287dde0b3254eabb55ecc6bdad2e400, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/afbea286f86d4b80bab44278800e282b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/a2fb9d8b1f8a40cba28e527b329e2d26, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/fd84e1bae15d49e4817ad9d83202640c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/7a3f2fc62aa7460f8d7b9cebf413b562] to archive 2023-10-31 05:54:37,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:37,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/9287dde0b3254eabb55ecc6bdad2e400 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/9287dde0b3254eabb55ecc6bdad2e400 2023-10-31 05:54:37,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/afbea286f86d4b80bab44278800e282b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/afbea286f86d4b80bab44278800e282b 2023-10-31 05:54:37,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/a2fb9d8b1f8a40cba28e527b329e2d26 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/a2fb9d8b1f8a40cba28e527b329e2d26 2023-10-31 05:54:37,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/fd84e1bae15d49e4817ad9d83202640c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/fd84e1bae15d49e4817ad9d83202640c 2023-10-31 05:54:37,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/7a3f2fc62aa7460f8d7b9cebf413b562 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/7a3f2fc62aa7460f8d7b9cebf413b562 2023-10-31 05:54:38,145 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231031856584eafdba49cc9b992981ba5789c5_del 2023-10-31 05:54:38,145 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031856584eafdba49cc9b992981ba5789c5_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231031856584eafdba49cc9b992981ba5789c5_del 2023-10-31 05:54:38,570 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 237360bc1e9947009f6bf5e8a79ab342 2023-10-31 05:54:38,571 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/237360bc1e9947009f6bf5e8a79ab342 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/237360bc1e9947009f6bf5e8a79ab342 2023-10-31 05:54:38,576 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 237360bc1e9947009f6bf5e8a79ab342 2023-10-31 05:54:38,577 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b7e12c6f039ff414ef8eee79c79535bf/family2 of b7e12c6f039ff414ef8eee79c79535bf into 237360bc1e9947009f6bf5e8a79ab342(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:54:38,577 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:38,577 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:38,577 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): eb42a9600adc7511b8ec2d129b0a1882/family1 is initiating major compaction (all files) 2023-10-31 05:54:38,577 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:38,577 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:38,577 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of eb42a9600adc7511b8ec2d129b0a1882/family1 in testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:38,577 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/a622f2699c4c4fc99b23c53fed503e57, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/2108c2f536cf47319df4f363d226ebea, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/667fa68c920b4558a21f704dd9d44415, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/00fd9f6249a0470392d40c12c47108bb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/06a4b41719ba4ea982ef7947551dc9a3] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp, totalSize=26.7 K 2023-10-31 05:54:38,578 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting a622f2699c4c4fc99b23c53fed503e57, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663362 2023-10-31 05:54:38,578 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 2108c2f536cf47319df4f363d226ebea, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664771 2023-10-31 05:54:38,579 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 667fa68c920b4558a21f704dd9d44415, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666210 2023-10-31 05:54:38,579 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 00fd9f6249a0470392d40c12c47108bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668028 2023-10-31 05:54:38,580 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 06a4b41719ba4ea982ef7947551dc9a3, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-31 05:54:38,591 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): eb42a9600adc7511b8ec2d129b0a1882#family1#compaction#111 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:38,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/85100bf9ebc14d4eb9777c58d74f5795, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/4e2a6984cb3c4c6da0b331506a2f6e47, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/6c218372c41a45eba43add83f759fd84, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/dfe68341782842c79beeb904a2e7fefb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/cb1a4b02f2dd46de9649abb92f4dfa9e] to archive 2023-10-31 05:54:38,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:38,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/85100bf9ebc14d4eb9777c58d74f5795 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/85100bf9ebc14d4eb9777c58d74f5795 2023-10-31 05:54:38,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/4e2a6984cb3c4c6da0b331506a2f6e47 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/4e2a6984cb3c4c6da0b331506a2f6e47 2023-10-31 05:54:38,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/6c218372c41a45eba43add83f759fd84 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/6c218372c41a45eba43add83f759fd84 2023-10-31 05:54:38,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/dfe68341782842c79beeb904a2e7fefb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/dfe68341782842c79beeb904a2e7fefb 2023-10-31 05:54:38,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/cb1a4b02f2dd46de9649abb92f4dfa9e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/cb1a4b02f2dd46de9649abb92f4dfa9e 2023-10-31 05:54:38,999 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023103134640e1ffbef45c2b1f152b79f1fcfd2_del 2023-10-31 05:54:38,999 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103134640e1ffbef45c2b1f152b79f1fcfd2_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103134640e1ffbef45c2b1f152b79f1fcfd2_del 2023-10-31 05:54:39,832 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0bb55bb9593c47f8afb9f9cdc2b43dea 2023-10-31 05:54:39,833 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/0bb55bb9593c47f8afb9f9cdc2b43dea as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/0bb55bb9593c47f8afb9f9cdc2b43dea 2023-10-31 05:54:39,839 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0bb55bb9593c47f8afb9f9cdc2b43dea 2023-10-31 05:54:39,841 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in eb42a9600adc7511b8ec2d129b0a1882/family1 of eb42a9600adc7511b8ec2d129b0a1882 into 0bb55bb9593c47f8afb9f9cdc2b43dea(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:54:39,841 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:39,841 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:39,841 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): eb42a9600adc7511b8ec2d129b0a1882/family2 is initiating major compaction (all files) 2023-10-31 05:54:39,841 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:39,842 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:39,842 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of eb42a9600adc7511b8ec2d129b0a1882/family2 in testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:39,842 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/e86ac80eb5054a9b9e44995d26622187, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/ddafac5cbaab41e7ac9bff616f08a090, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/5c9df285c28f416ba2805ae46ec55263, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/bba13718c93844f2abd2fe349febfec3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/82858b009c3349edad42f5c3b443bf2b] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp, totalSize=25.4 K 2023-10-31 05:54:39,843 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting e86ac80eb5054a9b9e44995d26622187, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663362 2023-10-31 05:54:39,843 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting ddafac5cbaab41e7ac9bff616f08a090, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664771 2023-10-31 05:54:39,844 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 5c9df285c28f416ba2805ae46ec55263, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666210 2023-10-31 05:54:39,844 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting bba13718c93844f2abd2fe349febfec3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668028 2023-10-31 05:54:39,845 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 82858b009c3349edad42f5c3b443bf2b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-31 05:54:39,858 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): eb42a9600adc7511b8ec2d129b0a1882#family2#compaction#112 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:39,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/a622f2699c4c4fc99b23c53fed503e57, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/2108c2f536cf47319df4f363d226ebea, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/667fa68c920b4558a21f704dd9d44415, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/00fd9f6249a0470392d40c12c47108bb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/06a4b41719ba4ea982ef7947551dc9a3] to archive 2023-10-31 05:54:39,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:39,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/a622f2699c4c4fc99b23c53fed503e57 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/a622f2699c4c4fc99b23c53fed503e57 2023-10-31 05:54:39,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/2108c2f536cf47319df4f363d226ebea to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/2108c2f536cf47319df4f363d226ebea 2023-10-31 05:54:39,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/667fa68c920b4558a21f704dd9d44415 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/667fa68c920b4558a21f704dd9d44415 2023-10-31 05:54:39,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/00fd9f6249a0470392d40c12c47108bb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/00fd9f6249a0470392d40c12c47108bb 2023-10-31 05:54:39,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/06a4b41719ba4ea982ef7947551dc9a3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/06a4b41719ba4ea982ef7947551dc9a3 2023-10-31 05:54:40,273 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310317f63ed59cdcc4c3fb8914e13670ad990_del 2023-10-31 05:54:40,273 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310317f63ed59cdcc4c3fb8914e13670ad990_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310317f63ed59cdcc4c3fb8914e13670ad990_del 2023-10-31 05:54:41,105 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c05e380e5122473eb91625159cd2c3cf 2023-10-31 05:54:41,106 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/c05e380e5122473eb91625159cd2c3cf as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/c05e380e5122473eb91625159cd2c3cf 2023-10-31 05:54:41,111 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c05e380e5122473eb91625159cd2c3cf 2023-10-31 05:54:41,111 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in eb42a9600adc7511b8ec2d129b0a1882/family2 of eb42a9600adc7511b8ec2d129b0a1882 into c05e380e5122473eb91625159cd2c3cf(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:54:41,112 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:41,116 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:41,121 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:41,126 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:41,127 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:41,134 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-31 05:54:41,166 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-31 05:54:41,169 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231031c7caa8092df94cddbe001e2bec448343_del 2023-10-31 05:54:41,173 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023103134640e1ffbef45c2b1f152b79f1fcfd2_del 2023-10-31 05:54:41,176 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310311b02ac41d08742828a769530ac80ecc3_del 2023-10-31 05:54:41,176 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:41,177 DEBUG [Listener at localhost/40291] zookeeper.ReadOnlyZKClient(139): Connect 0x72cb94a3 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:54:41,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/e86ac80eb5054a9b9e44995d26622187, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/ddafac5cbaab41e7ac9bff616f08a090, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/5c9df285c28f416ba2805ae46ec55263, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/bba13718c93844f2abd2fe349febfec3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/82858b009c3349edad42f5c3b443bf2b] to archive 2023-10-31 05:54:41,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:41,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/e86ac80eb5054a9b9e44995d26622187 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/e86ac80eb5054a9b9e44995d26622187 2023-10-31 05:54:41,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/ddafac5cbaab41e7ac9bff616f08a090 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/ddafac5cbaab41e7ac9bff616f08a090 2023-10-31 05:54:41,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/5c9df285c28f416ba2805ae46ec55263 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/5c9df285c28f416ba2805ae46ec55263 2023-10-31 05:54:41,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/bba13718c93844f2abd2fe349febfec3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/bba13718c93844f2abd2fe349febfec3 2023-10-31 05:54:41,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/82858b009c3349edad42f5c3b443bf2b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/82858b009c3349edad42f5c3b443bf2b 2023-10-31 05:54:41,317 DEBUG [Listener at localhost/40291] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c24a9f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:54:41,317 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:41,318 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:41,318 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:42,202 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031a24342ecf39d47b38a60b3987dfc7658 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031a24342ecf39d47b38a60b3987dfc7658 2023-10-31 05:54:42,202 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031be4423b90f944f7b8e2e879af418871b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031be4423b90f944f7b8e2e879af418871b 2023-10-31 05:54:42,202 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031a9289821e80f410a99dbf1992625d91a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031a9289821e80f410a99dbf1992625d91a 2023-10-31 05:54:42,203 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:42,203 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:42,203 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:42,215 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:54:42,218 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:54:42,228 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:54:42,232 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:54:42,246 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231031/family1/7b1595fd3afe42c8a03b8dab8c329cda first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-31 05:54:42,246 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231031/family1/37c3bb0a78ec4b27b28a2e3a1401afc8 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-31 05:54:42,246 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231031/family1/e0815d3599584d9aa6c4bceddb7d615e first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-31 05:54:42,248 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231031/family1/e0815d3599584d9aa6c4bceddb7d615e}] 2023-10-31 05:54:42,248 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231031/family1/37c3bb0a78ec4b27b28a2e3a1401afc8}] 2023-10-31 05:54:42,248 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231031/family1/7b1595fd3afe42c8a03b8dab8c329cda}] 2023-10-31 05:54:42,252 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231031/family1/e0815d3599584d9aa6c4bceddb7d615e for inclusion in f22d093a048d2c7989ada8d66d0a76fb/family1 2023-10-31 05:54:42,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231031/family1/7b1595fd3afe42c8a03b8dab8c329cda for inclusion in b7e12c6f039ff414ef8eee79c79535bf/family1 2023-10-31 05:54:42,252 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231031/family1/37c3bb0a78ec4b27b28a2e3a1401afc8 for inclusion in eb42a9600adc7511b8ec2d129b0a1882/family1 2023-10-31 05:54:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-31 05:54:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-31 05:54:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-31 05:54:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-31 05:54:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-31 05:54:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last=1 2023-10-31 05:54:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:42,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231031/family1/7b1595fd3afe42c8a03b8dab8c329cda to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__8bk0kikvkpmvhvcnqvqbrra6rcqif1uq8avjeoe82sfisv7fgm2946hs4si0j3gk/family1/7b1595fd3afe42c8a03b8dab8c329cda 2023-10-31 05:54:42,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231031/family1/37c3bb0a78ec4b27b28a2e3a1401afc8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__7saip9gsr516okoh8tpltl5n0ph9qv73hss84mfn5khrno8vanci756sbst552cj/family1/37c3bb0a78ec4b27b28a2e3a1401afc8 2023-10-31 05:54:42,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231031/family1/e0815d3599584d9aa6c4bceddb7d615e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__nsdvbu9l1hd4djoa1jvhsmi4nnf7vddjtkammb83joe8i7svqpbi7poq020o7k83/family1/e0815d3599584d9aa6c4bceddb7d615e 2023-10-31 05:54:42,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__8bk0kikvkpmvhvcnqvqbrra6rcqif1uq8avjeoe82sfisv7fgm2946hs4si0j3gk/family1/7b1595fd3afe42c8a03b8dab8c329cda as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/2c3fbdc0fd1b48e39a193602f2d2a09b_SeqId_29_ 2023-10-31 05:54:42,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__nsdvbu9l1hd4djoa1jvhsmi4nnf7vddjtkammb83joe8i7svqpbi7poq020o7k83/family1/e0815d3599584d9aa6c4bceddb7d615e as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/ea04cca00640489c9b2cc42e3f3cf17d_SeqId_29_ 2023-10-31 05:54:42,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__7saip9gsr516okoh8tpltl5n0ph9qv73hss84mfn5khrno8vanci756sbst552cj/family1/37c3bb0a78ec4b27b28a2e3a1401afc8 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/d4fb15f3228c47619194db035b09d8af_SeqId_29_ 2023-10-31 05:54:42,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__8bk0kikvkpmvhvcnqvqbrra6rcqif1uq8avjeoe82sfisv7fgm2946hs4si0j3gk/family1/7b1595fd3afe42c8a03b8dab8c329cda into b7e12c6f039ff414ef8eee79c79535bf/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/2c3fbdc0fd1b48e39a193602f2d2a09b_SeqId_29_ - updating store file list. 2023-10-31 05:54:42,259 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__nsdvbu9l1hd4djoa1jvhsmi4nnf7vddjtkammb83joe8i7svqpbi7poq020o7k83/family1/e0815d3599584d9aa6c4bceddb7d615e into f22d093a048d2c7989ada8d66d0a76fb/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/ea04cca00640489c9b2cc42e3f3cf17d_SeqId_29_ - updating store file list. 2023-10-31 05:54:42,259 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__7saip9gsr516okoh8tpltl5n0ph9qv73hss84mfn5khrno8vanci756sbst552cj/family1/37c3bb0a78ec4b27b28a2e3a1401afc8 into eb42a9600adc7511b8ec2d129b0a1882/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/d4fb15f3228c47619194db035b09d8af_SeqId_29_ - updating store file list. 2023-10-31 05:54:42,264 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/d4fb15f3228c47619194db035b09d8af_SeqId_29_ into eb42a9600adc7511b8ec2d129b0a1882/family1 2023-10-31 05:54:42,264 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__7saip9gsr516okoh8tpltl5n0ph9qv73hss84mfn5khrno8vanci756sbst552cj/family1/37c3bb0a78ec4b27b28a2e3a1401afc8 into eb42a9600adc7511b8ec2d129b0a1882/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/d4fb15f3228c47619194db035b09d8af_SeqId_29_) 2023-10-31 05:54:42,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__7saip9gsr516okoh8tpltl5n0ph9qv73hss84mfn5khrno8vanci756sbst552cj/family1/37c3bb0a78ec4b27b28a2e3a1401afc8 2023-10-31 05:54:42,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/2c3fbdc0fd1b48e39a193602f2d2a09b_SeqId_29_ into b7e12c6f039ff414ef8eee79c79535bf/family1 2023-10-31 05:54:42,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__8bk0kikvkpmvhvcnqvqbrra6rcqif1uq8avjeoe82sfisv7fgm2946hs4si0j3gk/family1/7b1595fd3afe42c8a03b8dab8c329cda into b7e12c6f039ff414ef8eee79c79535bf/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/2c3fbdc0fd1b48e39a193602f2d2a09b_SeqId_29_) 2023-10-31 05:54:42,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__8bk0kikvkpmvhvcnqvqbrra6rcqif1uq8avjeoe82sfisv7fgm2946hs4si0j3gk/family1/7b1595fd3afe42c8a03b8dab8c329cda 2023-10-31 05:54:42,266 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:42,264 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/ea04cca00640489c9b2cc42e3f3cf17d_SeqId_29_ into f22d093a048d2c7989ada8d66d0a76fb/family1 2023-10-31 05:54:42,266 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__nsdvbu9l1hd4djoa1jvhsmi4nnf7vddjtkammb83joe8i7svqpbi7poq020o7k83/family1/e0815d3599584d9aa6c4bceddb7d615e into f22d093a048d2c7989ada8d66d0a76fb/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/ea04cca00640489c9b2cc42e3f3cf17d_SeqId_29_) 2023-10-31 05:54:42,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__nsdvbu9l1hd4djoa1jvhsmi4nnf7vddjtkammb83joe8i7svqpbi7poq020o7k83/family1/e0815d3599584d9aa6c4bceddb7d615e 2023-10-31 05:54:42,267 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:42,267 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:42,268 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:42,268 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310314d8f55700ece40e982ba0bc138242f13 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310314d8f55700ece40e982ba0bc138242f13 2023-10-31 05:54:42,269 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:42,269 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310312afb309d45a54170b221abc86bcc0174 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310312afb309d45a54170b221abc86bcc0174 2023-10-31 05:54:42,269 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031600b2f80e18f4286b54c1b0be5c7ae4f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031600b2f80e18f4286b54c1b0be5c7ae4f 2023-10-31 05:54:42,269 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:42,270 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310314789d74ddb804183aa48a5973381545f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310314789d74ddb804183aa48a5973381545f 2023-10-31 05:54:42,270 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310316219b08ba5214e99b26cc1e35e30a4ae to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310316219b08ba5214e99b26cc1e35e30a4ae 2023-10-31 05:54:42,270 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023103197580ffd55b3462f885c5e51c2f01fb0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023103197580ffd55b3462f885c5e51c2f01fb0 2023-10-31 05:54:42,271 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031776f3a1986f648c9a37bc1c834baa568 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031776f3a1986f648c9a37bc1c834baa568 2023-10-31 05:54:42,271 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-31 05:54:42,271 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231031' 2023-10-31 05:54:42,271 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310314f9e0582898040b697e45d0aee7063da to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310314f9e0582898040b697e45d0aee7063da 2023-10-31 05:54:42,271 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031e21644beb17b4d7c976028bcb5a65f95 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031e21644beb17b4d7c976028bcb5a65f95 2023-10-31 05:54:42,272 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:42,272 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031e8b7131d0e614ceb9b6e097ce224bef3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031e8b7131d0e614ceb9b6e097ce224bef3 2023-10-31 05:54:42,272 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-31 05:54:42,272 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231031' 2023-10-31 05:54:42,272 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031f551a2d3e4514b26b0aa311de217e343 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031f551a2d3e4514b26b0aa311de217e343 2023-10-31 05:54:42,272 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:42,273 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031f574ec4e23004a7db1656ea9f05e6fd4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031f574ec4e23004a7db1656ea9f05e6fd4 2023-10-31 05:54:42,273 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-31 05:54:42,273 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231031' 2023-10-31 05:54:42,273 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:42,273 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:42,273 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:42,273 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031c7caa8092df94cddbe001e2bec448343_del] 2023-10-31 05:54:42,274 DEBUG [Listener at localhost/40291] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:42,275 DEBUG [Listener at localhost/40291] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031c7caa8092df94cddbe001e2bec448343_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031c7caa8092df94cddbe001e2bec448343_del 2023-10-31 05:54:42,275 INFO [Listener at localhost/40291] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-31 05:54:42,275 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103134640e1ffbef45c2b1f152b79f1fcfd2_del] 2023-10-31 05:54:42,275 DEBUG [Listener at localhost/40291] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:42,276 DEBUG [Listener at localhost/40291] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103134640e1ffbef45c2b1f152b79f1fcfd2_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103134640e1ffbef45c2b1f152b79f1fcfd2_del 2023-10-31 05:54:42,276 INFO [Listener at localhost/40291] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-31 05:54:42,276 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310311b02ac41d08742828a769530ac80ecc3_del] 2023-10-31 05:54:42,276 DEBUG [Listener at localhost/40291] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:42,277 DEBUG [Listener at localhost/40291] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310311b02ac41d08742828a769530ac80ecc3_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310311b02ac41d08742828a769530ac80ecc3_del 2023-10-31 05:54:42,277 INFO [Listener at localhost/40291] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-31 05:54:42,280 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:42,283 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:42,287 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:42,288 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:42,294 INFO [Listener at localhost/40291] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-10-31 05:54:42,294 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-10-31 05:54:42,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-10-31 05:54:42,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-31 05:54:42,297 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731682297"}]},"ts":"1698731682297"} 2023-10-31 05:54:42,298 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-10-31 05:54:42,299 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-10-31 05:54:42,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, UNASSIGN}] 2023-10-31 05:54:42,301 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, UNASSIGN 2023-10-31 05:54:42,301 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, UNASSIGN 2023-10-31 05:54:42,302 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, UNASSIGN 2023-10-31 05:54:42,302 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f22d093a048d2c7989ada8d66d0a76fb, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:42,302 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=eb42a9600adc7511b8ec2d129b0a1882, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:42,302 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b7e12c6f039ff414ef8eee79c79535bf, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:42,302 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731682302"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731682302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731682302"}]},"ts":"1698731682302"} 2023-10-31 05:54:42,302 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731682302"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731682302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731682302"}]},"ts":"1698731682302"} 2023-10-31 05:54:42,302 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731682302"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731682302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731682302"}]},"ts":"1698731682302"} 2023-10-31 05:54:42,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure b7e12c6f039ff414ef8eee79c79535bf, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:42,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure f22d093a048d2c7989ada8d66d0a76fb, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:42,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure eb42a9600adc7511b8ec2d129b0a1882, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:42,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-31 05:54:42,400 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase20.apache.org,43723,1698731565849, timeout=1698731682454, delay=55, operations=[pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure b7e12c6f039ff414ef8eee79c79535bf, server=jenkins-hbase20.apache.org,43723,1698731565849, pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure f22d093a048d2c7989ada8d66d0a76fb, server=jenkins-hbase20.apache.org,43723,1698731565849, pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure eb42a9600adc7511b8ec2d129b0a1882, server=jenkins-hbase20.apache.org,43723,1698731565849]] 2023-10-31 05:54:42,454 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:42,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:42,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b7e12c6f039ff414ef8eee79c79535bf, disabling compactions & flushes 2023-10-31 05:54:42,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:42,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:42,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. after waiting 0 ms 2023-10-31 05:54:42,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:42,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-31 05:54:42,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:42,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:42,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:42,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:42,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f22d093a048d2c7989ada8d66d0a76fb, disabling compactions & flushes 2023-10-31 05:54:42,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:42,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:42,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. after waiting 0 ms 2023-10-31 05:54:42,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:42,469 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b7e12c6f039ff414ef8eee79c79535bf, regionState=CLOSED 2023-10-31 05:54:42,469 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731682469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731682469"}]},"ts":"1698731682469"} 2023-10-31 05:54:42,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=91 2023-10-31 05:54:42,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure b7e12c6f039ff414ef8eee79c79535bf, server=jenkins-hbase20.apache.org,43723,1698731565849 in 168 msec 2023-10-31 05:54:42,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-31 05:54:42,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, UNASSIGN in 173 msec 2023-10-31 05:54:42,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:42,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:42,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:42,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:42,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing eb42a9600adc7511b8ec2d129b0a1882, disabling compactions & flushes 2023-10-31 05:54:42,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:42,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:42,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. after waiting 0 ms 2023-10-31 05:54:42,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:42,479 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f22d093a048d2c7989ada8d66d0a76fb, regionState=CLOSED 2023-10-31 05:54:42,479 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731682479"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731682479"}]},"ts":"1698731682479"} 2023-10-31 05:54:42,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-10-31 05:54:42,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure f22d093a048d2c7989ada8d66d0a76fb, server=jenkins-hbase20.apache.org,43723,1698731565849 in 176 msec 2023-10-31 05:54:42,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, UNASSIGN in 182 msec 2023-10-31 05:54:42,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-31 05:54:42,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:42,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:42,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:42,486 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=eb42a9600adc7511b8ec2d129b0a1882, regionState=CLOSED 2023-10-31 05:54:42,486 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731682486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731682486"}]},"ts":"1698731682486"} 2023-10-31 05:54:42,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=90 2023-10-31 05:54:42,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure eb42a9600adc7511b8ec2d129b0a1882, server=jenkins-hbase20.apache.org,43723,1698731565849 in 183 msec 2023-10-31 05:54:42,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=90, resume processing ppid=88 2023-10-31 05:54:42,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, UNASSIGN in 189 msec 2023-10-31 05:54:42,491 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731682491"}]},"ts":"1698731682491"} 2023-10-31 05:54:42,493 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-10-31 05:54:42,494 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-10-31 05:54:42,496 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 201 msec 2023-10-31 05:54:42,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-31 05:54:42,601 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-10-31 05:54:42,619 INFO [Listener at localhost/40291] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1698731669850-1698731682619 2023-10-31 05:54:42,619 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-31 05:54:42,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698731682620 (current time:1698731682620). 2023-10-31 05:54:42,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-31 05:54:42,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] zookeeper.ReadOnlyZKClient(139): Connect 0x5b57d77c to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:54:42,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f3d9ab8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:54:42,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:54:42,628 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:54:42,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b57d77c to 127.0.0.1:64652 2023-10-31 05:54:42,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:54:42,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-31 05:54:42,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-31 05:54:42,633 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot, current working dir path: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698731669850-1698731682619 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-31 05:54:42,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-31 05:54:42,637 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-31 05:54:42,637 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698732282637 2023-10-31 05:54:42,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-31 05:54:42,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1698731669850-1698731682619 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-31 05:54:42,638 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:42,638 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-31 05:54:42,738 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-31 05:54:42,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-31 05:54:42,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-31 05:54:42,742 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-31 05:54:42,942 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-31 05:54:42,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-31 05:54:42,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-31 05:54:42,946 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-31 05:54:43,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-10-31 05:54:43,056 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-31 05:54:43,056 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-31 05:54:43,056 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-31 05:54:43,057 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-31 05:54:43,057 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-31 05:54:43,057 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-31 05:54:43,057 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-31 05:54:43,057 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-31 05:54:43,059 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/0bb55bb9593c47f8afb9f9cdc2b43dea, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/d4fb15f3228c47619194db035b09d8af_SeqId_29_] hfiles 2023-10-31 05:54:43,059 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/0bb55bb9593c47f8afb9f9cdc2b43dea 2023-10-31 05:54:43,059 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/0e87f007eb054a72b68660c985cc5a2b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/2c3fbdc0fd1b48e39a193602f2d2a09b_SeqId_29_] hfiles 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/d4fb15f3228c47619194db035b09d8af_SeqId_29_ 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d68654e3831c434b8e49350ffde7a7d2, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/ea04cca00640489c9b2cc42e3f3cf17d_SeqId_29_] hfiles 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/0e87f007eb054a72b68660c985cc5a2b 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d68654e3831c434b8e49350ffde7a7d2 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/2c3fbdc0fd1b48e39a193602f2d2a09b_SeqId_29_ 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/ea04cca00640489c9b2cc42e3f3cf17d_SeqId_29_ 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031a9289821e80f410a99dbf1992625d91a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031a24342ecf39d47b38a60b3987dfc7658, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031be4423b90f944f7b8e2e879af418871b] hfiles 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031a9289821e80f410a99dbf1992625d91a 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031a24342ecf39d47b38a60b3987dfc7658 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031be4423b90f944f7b8e2e879af418871b 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/c05e380e5122473eb91625159cd2c3cf] hfiles 2023-10-31 05:54:43,060 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/c05e380e5122473eb91625159cd2c3cf 2023-10-31 05:54:43,061 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/237360bc1e9947009f6bf5e8a79ab342] hfiles 2023-10-31 05:54:43,061 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/237360bc1e9947009f6bf5e8a79ab342 2023-10-31 05:54:43,061 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/520226455aee4b4c8645a1493a3684f7] hfiles 2023-10-31 05:54:43,061 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/520226455aee4b4c8645a1493a3684f7 2023-10-31 05:54:43,066 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310311ad31dfe379a4bf792bff3f7701b4625, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231031298690a82a0a4e70ba6a01d6636e82d8, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310314309da408979412ba8567234dc81c597, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310314e2ee7bef7924f05a5495028f076ea30, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310317f63ed59cdcc4c3fb8914e13670ad990_del, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310311053c2acbd8744c28857c8a5170bbb16, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310312ba9bc0058294c8f8531a7809dee9861, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310313f598e186dd04cf1805d8c07f321b188, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231031856584eafdba49cc9b992981ba5789c5_del, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231031e47a58814a674a4f812f133b3aa21778, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310314e54fc7a642d43d49ca30e26d049b11e, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310315a32605e90f9431484382450f3b76fae, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031b4f03822353b47688d156c2484621591, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031faf98948ede5471985617e6703cb4342_del, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031fbf12609cb474507848635f3e40e9421] hfiles 2023-10-31 05:54:43,066 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310311ad31dfe379a4bf792bff3f7701b4625 2023-10-31 05:54:43,066 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231031298690a82a0a4e70ba6a01d6636e82d8 2023-10-31 05:54:43,066 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310314309da408979412ba8567234dc81c597 2023-10-31 05:54:43,066 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310314e2ee7bef7924f05a5495028f076ea30 2023-10-31 05:54:43,066 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310317f63ed59cdcc4c3fb8914e13670ad990_del 2023-10-31 05:54:43,067 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310311053c2acbd8744c28857c8a5170bbb16 2023-10-31 05:54:43,067 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310312ba9bc0058294c8f8531a7809dee9861 2023-10-31 05:54:43,067 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310313f598e186dd04cf1805d8c07f321b188 2023-10-31 05:54:43,067 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231031856584eafdba49cc9b992981ba5789c5_del 2023-10-31 05:54:43,067 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231031e47a58814a674a4f812f133b3aa21778 2023-10-31 05:54:43,067 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310314e54fc7a642d43d49ca30e26d049b11e 2023-10-31 05:54:43,067 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310315a32605e90f9431484382450f3b76fae 2023-10-31 05:54:43,067 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031b4f03822353b47688d156c2484621591 2023-10-31 05:54:43,067 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031faf98948ede5471985617e6703cb4342_del 2023-10-31 05:54:43,067 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031fbf12609cb474507848635f3e40e9421 2023-10-31 05:54:43,246 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-31 05:54:43,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-31 05:54:43,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-31 05:54:43,249 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-31 05:54:43,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-10-31 05:54:43,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1698731669850-1698731682619 2023-10-31 05:54:43,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698731669850-1698731682619 2023-10-31 05:54:43,750 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-31 05:54:43,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-31 05:54:43,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-31 05:54:43,753 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-31 05:54:43,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698731669850-1698731682619 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/hbase-failsafe-snaptb-1698731669850-1698731682619 2023-10-31 05:54:43,909 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1698731669850-1698731682619 of table testCompactionWithHFileLink completed 2023-10-31 05:54:43,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698731669850-1698731682619 2023-10-31 05:54:43,910 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698731669850-1698731682619 2023-10-31 05:54:43,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1698731669850-1698731682619 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698731682638Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1698731683051 (+413 ms)Consolidate snapshot: hbase-failsafe-snaptb-1698731669850-1698731682619 at 1698731683472 (+421 ms)Loading Region manifests for hbase-failsafe-snaptb-1698731669850-1698731682619 at 1698731683472Writing data manifest for hbase-failsafe-snaptb-1698731669850-1698731682619 at 1698731683480 (+8 ms)Verifying snapshot: hbase-failsafe-snaptb-1698731669850-1698731682619 at 1698731683891 (+411 ms)Snapshot hbase-failsafe-snaptb-1698731669850-1698731682619 of table testCompactionWithHFileLink completed at 1698731683909 (+18 ms) 2023-10-31 05:54:43,911 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-31 05:54:43,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2760 sec 2023-10-31 05:54:44,753 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-31 05:54:44,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-31 05:54:44,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1698731669850-1698731682619 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-31 05:54:44,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698731669850" table: "testCompactionWithHFileLink" creation_time: 1698731669864 type: FLUSH version: 2 ttl: 0 ) 2023-10-31 05:54:44,797 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1698731669850 as table=testCompactionWithHFileLink 2023-10-31 05:54:44,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-31 05:54:44,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-31 05:54:45,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-31 05:54:45,209 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-31 05:54:45,210 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-31 05:54:45,211 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-31 05:54:45,211 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-31 05:54:45,216 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1698731669850" table: "testCompactionWithHFileLink" creation_time: 1698731669864 type: FLUSH version: 2 ttl: 0 2023-10-31 05:54:45,216 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink 2023-10-31 05:54:45,222 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-10-31 05:54:45,225 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031a9289821e80f410a99dbf1992625d91a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031a9289821e80f410a99dbf1992625d91a 2023-10-31 05:54:45,226 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031a24342ecf39d47b38a60b3987dfc7658 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031a24342ecf39d47b38a60b3987dfc7658 2023-10-31 05:54:45,228 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031be4423b90f944f7b8e2e879af418871b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031be4423b90f944f7b8e2e879af418871b 2023-10-31 05:54:45,228 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310314d8f55700ece40e982ba0bc138242f13 of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,231 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231031600b2f80e18f4286b54c1b0be5c7ae4f of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,233 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310316219b08ba5214e99b26cc1e35e30a4ae of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,236 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231031776f3a1986f648c9a37bc1c834baa568 of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,239 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310312afb309d45a54170b221abc86bcc0174 of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,242 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310314789d74ddb804183aa48a5973381545f of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,245 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310314f9e0582898040b697e45d0aee7063da of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,248 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231031e8b7131d0e614ceb9b6e097ce224bef3 of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,252 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023103197580ffd55b3462f885c5e51c2f01fb0 of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,256 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231031e21644beb17b4d7c976028bcb5a65f95 of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,259 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231031f551a2d3e4514b26b0aa311de217e343 of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,261 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231031f574ec4e23004a7db1656ea9f05e6fd4 of snapshot=snaptb-1698731669850 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-31 05:54:45,266 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231031856584eafdba49cc9b992981ba5789c5_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231031856584eafdba49cc9b992981ba5789c5_del 2023-10-31 05:54:45,267 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310317f63ed59cdcc4c3fb8914e13670ad990_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310317f63ed59cdcc4c3fb8914e13670ad990_del 2023-10-31 05:54:45,269 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031faf98948ede5471985617e6703cb4342_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231031faf98948ede5471985617e6703cb4342_del 2023-10-31 05:54:45,269 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:45,269 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:45,269 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:45,272 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/2c3fbdc0fd1b48e39a193602f2d2a09b_SeqId_29_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/2c3fbdc0fd1b48e39a193602f2d2a09b_SeqId_29_ 2023-10-31 05:54:45,272 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/ea04cca00640489c9b2cc42e3f3cf17d_SeqId_29_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/ea04cca00640489c9b2cc42e3f3cf17d_SeqId_29_ 2023-10-31 05:54:45,272 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/0bb55bb9593c47f8afb9f9cdc2b43dea to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/0bb55bb9593c47f8afb9f9cdc2b43dea 2023-10-31 05:54:45,274 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/0e87f007eb054a72b68660c985cc5a2b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/0e87f007eb054a72b68660c985cc5a2b 2023-10-31 05:54:45,274 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9287dde0b3254eabb55ecc6bdad2e400 of snapshot=snaptb-1698731669850 to region=b7e12c6f039ff414ef8eee79c79535bf table=testCompactionWithHFileLink 2023-10-31 05:54:45,274 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d68654e3831c434b8e49350ffde7a7d2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/d68654e3831c434b8e49350ffde7a7d2 2023-10-31 05:54:45,274 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/d4fb15f3228c47619194db035b09d8af_SeqId_29_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/d4fb15f3228c47619194db035b09d8af_SeqId_29_ 2023-10-31 05:54:45,274 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2774acb1012f42999a4abecb50e157bb of snapshot=snaptb-1698731669850 to region=f22d093a048d2c7989ada8d66d0a76fb table=testCompactionWithHFileLink 2023-10-31 05:54:45,274 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a622f2699c4c4fc99b23c53fed503e57 of snapshot=snaptb-1698731669850 to region=eb42a9600adc7511b8ec2d129b0a1882 table=testCompactionWithHFileLink 2023-10-31 05:54:45,278 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink afbea286f86d4b80bab44278800e282b of snapshot=snaptb-1698731669850 to region=b7e12c6f039ff414ef8eee79c79535bf table=testCompactionWithHFileLink 2023-10-31 05:54:45,278 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7a355f9f198d415d998b610b1810291f of snapshot=snaptb-1698731669850 to region=f22d093a048d2c7989ada8d66d0a76fb table=testCompactionWithHFileLink 2023-10-31 05:54:45,278 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2108c2f536cf47319df4f363d226ebea of snapshot=snaptb-1698731669850 to region=eb42a9600adc7511b8ec2d129b0a1882 table=testCompactionWithHFileLink 2023-10-31 05:54:45,282 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a2fb9d8b1f8a40cba28e527b329e2d26 of snapshot=snaptb-1698731669850 to region=b7e12c6f039ff414ef8eee79c79535bf table=testCompactionWithHFileLink 2023-10-31 05:54:45,282 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 73a7ba34b5a648c08bbb39fde60a690c of snapshot=snaptb-1698731669850 to region=f22d093a048d2c7989ada8d66d0a76fb table=testCompactionWithHFileLink 2023-10-31 05:54:45,282 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 667fa68c920b4558a21f704dd9d44415 of snapshot=snaptb-1698731669850 to region=eb42a9600adc7511b8ec2d129b0a1882 table=testCompactionWithHFileLink 2023-10-31 05:54:45,285 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fd84e1bae15d49e4817ad9d83202640c of snapshot=snaptb-1698731669850 to region=b7e12c6f039ff414ef8eee79c79535bf table=testCompactionWithHFileLink 2023-10-31 05:54:45,285 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d0d514f5e62f4c999dee316ccfc18d3c of snapshot=snaptb-1698731669850 to region=f22d093a048d2c7989ada8d66d0a76fb table=testCompactionWithHFileLink 2023-10-31 05:54:45,286 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 00fd9f6249a0470392d40c12c47108bb of snapshot=snaptb-1698731669850 to region=eb42a9600adc7511b8ec2d129b0a1882 table=testCompactionWithHFileLink 2023-10-31 05:54:45,289 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/520226455aee4b4c8645a1493a3684f7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/520226455aee4b4c8645a1493a3684f7 2023-10-31 05:54:45,289 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/237360bc1e9947009f6bf5e8a79ab342 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/237360bc1e9947009f6bf5e8a79ab342 2023-10-31 05:54:45,289 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b0d609119ea84277bac801323aacb747 of snapshot=snaptb-1698731669850 to region=f22d093a048d2c7989ada8d66d0a76fb table=testCompactionWithHFileLink 2023-10-31 05:54:45,289 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 85100bf9ebc14d4eb9777c58d74f5795 of snapshot=snaptb-1698731669850 to region=b7e12c6f039ff414ef8eee79c79535bf table=testCompactionWithHFileLink 2023-10-31 05:54:45,290 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/c05e380e5122473eb91625159cd2c3cf to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/c05e380e5122473eb91625159cd2c3cf 2023-10-31 05:54:45,290 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e86ac80eb5054a9b9e44995d26622187 of snapshot=snaptb-1698731669850 to region=eb42a9600adc7511b8ec2d129b0a1882 table=testCompactionWithHFileLink 2023-10-31 05:54:45,292 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4e2a6984cb3c4c6da0b331506a2f6e47 of snapshot=snaptb-1698731669850 to region=b7e12c6f039ff414ef8eee79c79535bf table=testCompactionWithHFileLink 2023-10-31 05:54:45,292 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 97299919220640efbaaae032eff206a1 of snapshot=snaptb-1698731669850 to region=f22d093a048d2c7989ada8d66d0a76fb table=testCompactionWithHFileLink 2023-10-31 05:54:45,292 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ddafac5cbaab41e7ac9bff616f08a090 of snapshot=snaptb-1698731669850 to region=eb42a9600adc7511b8ec2d129b0a1882 table=testCompactionWithHFileLink 2023-10-31 05:54:45,299 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 997efb8497c94665857d3ef62b776dc2 of snapshot=snaptb-1698731669850 to region=f22d093a048d2c7989ada8d66d0a76fb table=testCompactionWithHFileLink 2023-10-31 05:54:45,299 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6c218372c41a45eba43add83f759fd84 of snapshot=snaptb-1698731669850 to region=b7e12c6f039ff414ef8eee79c79535bf table=testCompactionWithHFileLink 2023-10-31 05:54:45,299 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5c9df285c28f416ba2805ae46ec55263 of snapshot=snaptb-1698731669850 to region=eb42a9600adc7511b8ec2d129b0a1882 table=testCompactionWithHFileLink 2023-10-31 05:54:45,301 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ee997ecbcaab423fae024542830ba6a0 of snapshot=snaptb-1698731669850 to region=f22d093a048d2c7989ada8d66d0a76fb table=testCompactionWithHFileLink 2023-10-31 05:54:45,301 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dfe68341782842c79beeb904a2e7fefb of snapshot=snaptb-1698731669850 to region=b7e12c6f039ff414ef8eee79c79535bf table=testCompactionWithHFileLink 2023-10-31 05:54:45,302 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bba13718c93844f2abd2fe349febfec3 of snapshot=snaptb-1698731669850 to region=eb42a9600adc7511b8ec2d129b0a1882 table=testCompactionWithHFileLink 2023-10-31 05:54:45,305 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1698731669850" table: "testCompactionWithHFileLink" creation_time: 1698731669864 type: FLUSH version: 2 ttl: 0 2023-10-31 05:54:45,306 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698731685306"}]},"ts":"9223372036854775807"} 2023-10-31 05:54:45,306 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698731685306"}]},"ts":"9223372036854775807"} 2023-10-31 05:54:45,306 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698731685306"}]},"ts":"9223372036854775807"} 2023-10-31 05:54:45,307 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-10-31 05:54:45,307 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b7e12c6f039ff414ef8eee79c79535bf, NAME => 'testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => eb42a9600adc7511b8ec2d129b0a1882, NAME => 'testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => f22d093a048d2c7989ada8d66d0a76fb, NAME => 'testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.', STARTKEY => '', ENDKEY => '1'}] 2023-10-31 05:54:45,308 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731685307"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731685307"}]},"ts":"1698731685307"} 2023-10-31 05:54:45,308 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731685307"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731685307"}]},"ts":"1698731685307"} 2023-10-31 05:54:45,308 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731685307"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731685307"}]},"ts":"1698731685307"} 2023-10-31 05:54:45,309 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-31 05:54:45,309 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-10-31 05:54:45,309 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => b7e12c6f039ff414ef8eee79c79535bf, NAME => 'testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => eb42a9600adc7511b8ec2d129b0a1882, NAME => 'testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => f22d093a048d2c7989ada8d66d0a76fb, NAME => 'testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.', STARTKEY => '', ENDKEY => '1'}] 2023-10-31 05:54:45,310 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1698731669850 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-10-31 05:54:45,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698731669850" table: "testCompactionWithHFileLink" creation_time: 1698731669864 type: FLUSH version: 2 ttl: 0 ) in 523 msec 2023-10-31 05:54:45,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-31 05:54:45,405 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-10-31 05:54:45,405 INFO [Listener at localhost/40291] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1698731669850-1698731682619 2023-10-31 05:54:45,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1698731669850-1698731682619" 2023-10-31 05:54:45,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1698731669850-1698731682619 2023-10-31 05:54:45,420 INFO [Listener at localhost/40291] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-10-31 05:54:45,423 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-10-31 05:54:45,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-10-31 05:54:45,431 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-10-31 05:54:45,431 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731685431"}]},"ts":"1698731685431"} 2023-10-31 05:54:45,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-31 05:54:45,432 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-31 05:54:45,434 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-10-31 05:54:45,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, ASSIGN}] 2023-10-31 05:54:45,436 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, ASSIGN 2023-10-31 05:54:45,436 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, ASSIGN 2023-10-31 05:54:45,436 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, ASSIGN 2023-10-31 05:54:45,437 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-31 05:54:45,437 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-31 05:54:45,437 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-31 05:54:45,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-31 05:54:45,590 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b7e12c6f039ff414ef8eee79c79535bf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:45,590 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=eb42a9600adc7511b8ec2d129b0a1882, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:45,591 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731685590"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731685590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731685590"}]},"ts":"1698731685590"} 2023-10-31 05:54:45,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731685590"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731685590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731685590"}]},"ts":"1698731685590"} 2023-10-31 05:54:45,590 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f22d093a048d2c7989ada8d66d0a76fb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:45,591 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731685590"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731685590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731685590"}]},"ts":"1698731685590"} 2023-10-31 05:54:45,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure b7e12c6f039ff414ef8eee79c79535bf, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:45,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure eb42a9600adc7511b8ec2d129b0a1882, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:45,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure f22d093a048d2c7989ada8d66d0a76fb, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:45,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-31 05:54:45,747 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:45,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:45,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb42a9600adc7511b8ec2d129b0a1882, NAME => 'testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.', STARTKEY => '1', ENDKEY => '2'} 2023-10-31 05:54:45,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:45,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:45,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:45,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:45,754 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:45,756 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1 2023-10-31 05:54:45,756 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1 2023-10-31 05:54:45,757 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb42a9600adc7511b8ec2d129b0a1882 columnFamilyName family1 2023-10-31 05:54:45,772 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-00fd9f6249a0470392d40c12c47108bb 2023-10-31 05:54:45,777 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-2108c2f536cf47319df4f363d226ebea 2023-10-31 05:54:45,782 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-667fa68c920b4558a21f704dd9d44415 2023-10-31 05:54:45,787 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-a622f2699c4c4fc99b23c53fed503e57 2023-10-31 05:54:45,787 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(310): Store=eb42a9600adc7511b8ec2d129b0a1882/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:45,787 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:45,788 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2 2023-10-31 05:54:45,788 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2 2023-10-31 05:54:45,788 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb42a9600adc7511b8ec2d129b0a1882 columnFamilyName family2 2023-10-31 05:54:45,796 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-5c9df285c28f416ba2805ae46ec55263 2023-10-31 05:54:45,804 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-bba13718c93844f2abd2fe349febfec3 2023-10-31 05:54:45,811 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-ddafac5cbaab41e7ac9bff616f08a090 2023-10-31 05:54:45,817 DEBUG [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-e86ac80eb5054a9b9e44995d26622187 2023-10-31 05:54:45,817 INFO [StoreOpener-eb42a9600adc7511b8ec2d129b0a1882-1] regionserver.HStore(310): Store=eb42a9600adc7511b8ec2d129b0a1882/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:45,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:45,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:45,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:54:45,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:54:45,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened eb42a9600adc7511b8ec2d129b0a1882; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68637486, jitterRate=0.022778242826461792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:54:45,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:45,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882., pid=102, masterSystemTime=1698731685746 2023-10-31 05:54:45,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:54:45,822 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-31 05:54:45,822 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-31 05:54:45,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-31 05:54:45,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:45,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:45,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:45,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f22d093a048d2c7989ada8d66d0a76fb, NAME => 'testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.', STARTKEY => '', ENDKEY => '1'} 2023-10-31 05:54:45,824 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=eb42a9600adc7511b8ec2d129b0a1882, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:45,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:45,824 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731685823"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731685823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731685823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731685823"}]},"ts":"1698731685823"} 2023-10-31 05:54:45,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:45,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:45,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:45,824 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-31 05:54:45,824 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-31 05:54:45,824 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1912): eb42a9600adc7511b8ec2d129b0a1882/family1 is initiating minor compaction (all files) 2023-10-31 05:54:45,824 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1912): eb42a9600adc7511b8ec2d129b0a1882/family2 is initiating minor compaction (all files) 2023-10-31 05:54:45,824 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegion(2259): Starting compaction of eb42a9600adc7511b8ec2d129b0a1882/family2 in testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:45,824 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of eb42a9600adc7511b8ec2d129b0a1882/family1 in testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:54:45,824 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-e86ac80eb5054a9b9e44995d26622187, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-ddafac5cbaab41e7ac9bff616f08a090, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-5c9df285c28f416ba2805ae46ec55263, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-bba13718c93844f2abd2fe349febfec3] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp, totalSize=20.4 K 2023-10-31 05:54:45,824 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-a622f2699c4c4fc99b23c53fed503e57, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-2108c2f536cf47319df4f363d226ebea, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-667fa68c920b4558a21f704dd9d44415, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-00fd9f6249a0470392d40c12c47108bb] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp, totalSize=21.6 K 2023-10-31 05:54:45,825 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:45,825 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-e86ac80eb5054a9b9e44995d26622187, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663362 2023-10-31 05:54:45,825 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-a622f2699c4c4fc99b23c53fed503e57, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663362 2023-10-31 05:54:45,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=99 2023-10-31 05:54:45,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure eb42a9600adc7511b8ec2d129b0a1882, server=jenkins-hbase20.apache.org,43723,1698731565849 in 231 msec 2023-10-31 05:54:45,827 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-ddafac5cbaab41e7ac9bff616f08a090, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664771 2023-10-31 05:54:45,827 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-2108c2f536cf47319df4f363d226ebea, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664771 2023-10-31 05:54:45,827 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-5c9df285c28f416ba2805ae46ec55263, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666210 2023-10-31 05:54:45,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=eb42a9600adc7511b8ec2d129b0a1882, ASSIGN in 392 msec 2023-10-31 05:54:45,828 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-667fa68c920b4558a21f704dd9d44415, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666210 2023-10-31 05:54:45,828 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-bba13718c93844f2abd2fe349febfec3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668028 2023-10-31 05:54:45,828 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-00fd9f6249a0470392d40c12c47108bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668028 2023-10-31 05:54:45,833 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1 2023-10-31 05:54:45,834 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1 2023-10-31 05:54:45,834 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f22d093a048d2c7989ada8d66d0a76fb columnFamilyName family1 2023-10-31 05:54:45,848 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-2774acb1012f42999a4abecb50e157bb 2023-10-31 05:54:45,859 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-73a7ba34b5a648c08bbb39fde60a690c 2023-10-31 05:54:45,866 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] throttle.PressureAwareThroughputController(145): eb42a9600adc7511b8ec2d129b0a1882#family2#compaction#113 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:45,866 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): eb42a9600adc7511b8ec2d129b0a1882#family1#compaction#114 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:45,870 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-7a355f9f198d415d998b610b1810291f 2023-10-31 05:54:45,881 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-d0d514f5e62f4c999dee316ccfc18d3c 2023-10-31 05:54:45,882 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(310): Store=f22d093a048d2c7989ada8d66d0a76fb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:45,882 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:45,883 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2 2023-10-31 05:54:45,883 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2 2023-10-31 05:54:45,883 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f22d093a048d2c7989ada8d66d0a76fb columnFamilyName family2 2023-10-31 05:54:45,890 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-97299919220640efbaaae032eff206a1 2023-10-31 05:54:45,894 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-997efb8497c94665857d3ef62b776dc2 2023-10-31 05:54:45,898 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-b0d609119ea84277bac801323aacb747 2023-10-31 05:54:45,903 DEBUG [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-ee997ecbcaab423fae024542830ba6a0 2023-10-31 05:54:45,903 INFO [StoreOpener-f22d093a048d2c7989ada8d66d0a76fb-1] regionserver.HStore(310): Store=f22d093a048d2c7989ada8d66d0a76fb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:45,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:45,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:45,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:54:45,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:54:45,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f22d093a048d2c7989ada8d66d0a76fb; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70859565, jitterRate=0.0558898001909256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:54:45,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:45,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb., pid=103, masterSystemTime=1698731685746 2023-10-31 05:54:45,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-31 05:54:45,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-31 05:54:45,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:45,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:45,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:45,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b7e12c6f039ff414ef8eee79c79535bf, NAME => 'testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.', STARTKEY => '2', ENDKEY => ''} 2023-10-31 05:54:45,909 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f22d093a048d2c7989ada8d66d0a76fb, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:45,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:45,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:45,910 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731685909"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731685909"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731685909"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731685909"}]},"ts":"1698731685909"} 2023-10-31 05:54:45,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:45,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:45,911 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:45,912 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1 2023-10-31 05:54:45,912 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1 2023-10-31 05:54:45,912 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7e12c6f039ff414ef8eee79c79535bf columnFamilyName family1 2023-10-31 05:54:45,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=98 2023-10-31 05:54:45,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure f22d093a048d2c7989ada8d66d0a76fb, server=jenkins-hbase20.apache.org,43723,1698731565849 in 315 msec 2023-10-31 05:54:45,913 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f22d093a048d2c7989ada8d66d0a76fb, ASSIGN in 478 msec 2023-10-31 05:54:45,922 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-9287dde0b3254eabb55ecc6bdad2e400 2023-10-31 05:54:45,928 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-a2fb9d8b1f8a40cba28e527b329e2d26 2023-10-31 05:54:45,934 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-afbea286f86d4b80bab44278800e282b 2023-10-31 05:54:45,941 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-fd84e1bae15d49e4817ad9d83202640c 2023-10-31 05:54:45,941 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(310): Store=b7e12c6f039ff414ef8eee79c79535bf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:45,941 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:45,942 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2 2023-10-31 05:54:45,942 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2 2023-10-31 05:54:45,942 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7e12c6f039ff414ef8eee79c79535bf columnFamilyName family2 2023-10-31 05:54:45,950 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-4e2a6984cb3c4c6da0b331506a2f6e47 2023-10-31 05:54:45,955 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-6c218372c41a45eba43add83f759fd84 2023-10-31 05:54:45,961 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-85100bf9ebc14d4eb9777c58d74f5795 2023-10-31 05:54:45,967 DEBUG [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(539): loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-dfe68341782842c79beeb904a2e7fefb 2023-10-31 05:54:45,968 INFO [StoreOpener-b7e12c6f039ff414ef8eee79c79535bf-1] regionserver.HStore(310): Store=b7e12c6f039ff414ef8eee79c79535bf/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:45,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:45,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:54:45,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:54:45,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b7e12c6f039ff414ef8eee79c79535bf; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61919060, jitterRate=-0.07733410596847534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:54:45,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:45,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf., pid=101, masterSystemTime=1698731685746 2023-10-31 05:54:45,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-31 05:54:45,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-31 05:54:45,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:45,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:45,975 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b7e12c6f039ff414ef8eee79c79535bf, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:45,975 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698731685975"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731685975"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731685975"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731685975"}]},"ts":"1698731685975"} 2023-10-31 05:54:45,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-10-31 05:54:45,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure b7e12c6f039ff414ef8eee79c79535bf, server=jenkins-hbase20.apache.org,43723,1698731565849 in 383 msec 2023-10-31 05:54:45,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=97 2023-10-31 05:54:45,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b7e12c6f039ff414ef8eee79c79535bf, ASSIGN in 543 msec 2023-10-31 05:54:45,979 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731685978"}]},"ts":"1698731685978"} 2023-10-31 05:54:45,979 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-31 05:54:45,980 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-10-31 05:54:45,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 557 msec 2023-10-31 05:54:46,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-31 05:54:46,037 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-10-31 05:54:46,053 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:46,060 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:46,067 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:46,068 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:46,073 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-31 05:54:46,087 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-31 05:54:46,087 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:46,088 DEBUG [Listener at localhost/40291] zookeeper.ReadOnlyZKClient(139): Connect 0x39db4897 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:54:46,091 DEBUG [Listener at localhost/40291] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d284051, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:54:46,092 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:46,092 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:46,092 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:46,581 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031f304aceaede74a9da582a0fa2d4dc9db to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231031f304aceaede74a9da582a0fa2d4dc9db 2023-10-31 05:54:46,582 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:46,593 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:54:46,596 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:54:46,602 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:54:46,605 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:54:46,614 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231031/family1/10c3a022a2df487c885e2771efc9c9fa first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-10-31 05:54:46,615 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231031/family1/10c3a022a2df487c885e2771efc9c9fa}] 2023-10-31 05:54:46,621 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231031/family1/10c3a022a2df487c885e2771efc9c9fa for inclusion in eb42a9600adc7511b8ec2d129b0a1882/family1 2023-10-31 05:54:46,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-10-31 05:54:46,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-31 05:54:46,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:46,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231031/family1/10c3a022a2df487c885e2771efc9c9fa to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__vdmo33sdht78ofkvqf4v998ja98pbbs1rqvp3luii6id3h0gevrv6a3gndve84gg/family1/10c3a022a2df487c885e2771efc9c9fa 2023-10-31 05:54:46,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__vdmo33sdht78ofkvqf4v998ja98pbbs1rqvp3luii6id3h0gevrv6a3gndve84gg/family1/10c3a022a2df487c885e2771efc9c9fa as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/51584917111b4442a2b7bfbe5bd57204_SeqId_34_ 2023-10-31 05:54:46,626 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__vdmo33sdht78ofkvqf4v998ja98pbbs1rqvp3luii6id3h0gevrv6a3gndve84gg/family1/10c3a022a2df487c885e2771efc9c9fa into eb42a9600adc7511b8ec2d129b0a1882/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/51584917111b4442a2b7bfbe5bd57204_SeqId_34_ - updating store file list. 2023-10-31 05:54:46,628 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/51584917111b4442a2b7bfbe5bd57204_SeqId_34_ into eb42a9600adc7511b8ec2d129b0a1882/family1 2023-10-31 05:54:46,628 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__vdmo33sdht78ofkvqf4v998ja98pbbs1rqvp3luii6id3h0gevrv6a3gndve84gg/family1/10c3a022a2df487c885e2771efc9c9fa into eb42a9600adc7511b8ec2d129b0a1882/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/51584917111b4442a2b7bfbe5bd57204_SeqId_34_) 2023-10-31 05:54:46,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__vdmo33sdht78ofkvqf4v998ja98pbbs1rqvp3luii6id3h0gevrv6a3gndve84gg/family1/10c3a022a2df487c885e2771efc9c9fa 2023-10-31 05:54:46,630 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:46,631 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:46,633 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310314d8f55700ece40e982ba0bc138242f13 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310314d8f55700ece40e982ba0bc138242f13 2023-10-31 05:54:46,634 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231031600b2f80e18f4286b54c1b0be5c7ae4f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231031600b2f80e18f4286b54c1b0be5c7ae4f 2023-10-31 05:54:46,635 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310316219b08ba5214e99b26cc1e35e30a4ae to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310316219b08ba5214e99b26cc1e35e30a4ae 2023-10-31 05:54:46,636 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231031776f3a1986f648c9a37bc1c834baa568 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231031776f3a1986f648c9a37bc1c834baa568 2023-10-31 05:54:46,636 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-31 05:54:46,636 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231031' 2023-10-31 05:54:46,637 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:46,701 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family1/7d3ee9ce63514e128ff4a2a321def815 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/7d3ee9ce63514e128ff4a2a321def815 2023-10-31 05:54:46,707 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in eb42a9600adc7511b8ec2d129b0a1882/family1 of eb42a9600adc7511b8ec2d129b0a1882 into 7d3ee9ce63514e128ff4a2a321def815(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:54:46,707 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:46,707 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882., storeName=eb42a9600adc7511b8ec2d129b0a1882/family1, priority=12, startTime=1698731685821; duration=0sec 2023-10-31 05:54:46,707 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-31 05:54:46,708 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-31 05:54:46,711 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-31 05:54:46,711 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1912): f22d093a048d2c7989ada8d66d0a76fb/family1 is initiating minor compaction (all files) 2023-10-31 05:54:46,711 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f22d093a048d2c7989ada8d66d0a76fb/family1 in testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:46,711 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-2774acb1012f42999a4abecb50e157bb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-7a355f9f198d415d998b610b1810291f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-73a7ba34b5a648c08bbb39fde60a690c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-d0d514f5e62f4c999dee316ccfc18d3c] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp, totalSize=21.6 K 2023-10-31 05:54:46,712 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-2774acb1012f42999a4abecb50e157bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663361 2023-10-31 05:54:46,713 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-7a355f9f198d415d998b610b1810291f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664770 2023-10-31 05:54:46,713 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-73a7ba34b5a648c08bbb39fde60a690c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666209 2023-10-31 05:54:46,714 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-d0d514f5e62f4c999dee316ccfc18d3c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668027 2023-10-31 05:54:46,732 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): f22d093a048d2c7989ada8d66d0a76fb#family1#compaction#115 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:46,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-a622f2699c4c4fc99b23c53fed503e57, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-2108c2f536cf47319df4f363d226ebea, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-667fa68c920b4558a21f704dd9d44415, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-00fd9f6249a0470392d40c12c47108bb] to archive 2023-10-31 05:54:46,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:46,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-a622f2699c4c4fc99b23c53fed503e57 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-a622f2699c4c4fc99b23c53fed503e57 2023-10-31 05:54:46,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-2108c2f536cf47319df4f363d226ebea to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-2108c2f536cf47319df4f363d226ebea 2023-10-31 05:54:46,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-667fa68c920b4558a21f704dd9d44415 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-667fa68c920b4558a21f704dd9d44415 2023-10-31 05:54:46,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-00fd9f6249a0470392d40c12c47108bb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family1/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-00fd9f6249a0470392d40c12c47108bb 2023-10-31 05:54:46,987 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031bb6e5760bb7840a09eeb47ff7e0d9408 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231031bb6e5760bb7840a09eeb47ff7e0d9408 2023-10-31 05:54:46,987 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031f4b6513000924709a7c19174008c8702 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231031f4b6513000924709a7c19174008c8702 2023-10-31 05:54:46,988 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:46,988 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:47,020 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231031/family1/dce4c18a40534cb7a69135b887c9812a first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-10-31 05:54:47,024 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=32 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231031/family1/dce4c18a40534cb7a69135b887c9812a}] 2023-10-31 05:54:47,026 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231031/family1/dce4c18a40534cb7a69135b887c9812a for inclusion in f22d093a048d2c7989ada8d66d0a76fb/family1 2023-10-31 05:54:47,026 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231031/family1/9082b279610c417bad9943aaf36e8d7d first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-10-31 05:54:47,027 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231031/family1/9082b279610c417bad9943aaf36e8d7d}] 2023-10-31 05:54:47,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231031/family1/9082b279610c417bad9943aaf36e8d7d for inclusion in b7e12c6f039ff414ef8eee79c79535bf/family1 2023-10-31 05:54:47,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-10-31 05:54:47,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last=1 2023-10-31 05:54:47,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:47,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231031/family1/dce4c18a40534cb7a69135b887c9812a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__rmiobo91mbeq60t2sj8chv4n14so9ri4r2546tc1ivfst3ctfortusrt15g1ba01/family1/dce4c18a40534cb7a69135b887c9812a 2023-10-31 05:54:47,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-10-31 05:54:47,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-31 05:54:47,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:47,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231031/family1/9082b279610c417bad9943aaf36e8d7d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__dnp1oujumurrpctbk9bakf2h88dl8lv77hu9g81svou77c3813t3bdc4a6905l0j/family1/9082b279610c417bad9943aaf36e8d7d 2023-10-31 05:54:47,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__rmiobo91mbeq60t2sj8chv4n14so9ri4r2546tc1ivfst3ctfortusrt15g1ba01/family1/dce4c18a40534cb7a69135b887c9812a as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/0c217e53326b4bbba80ebb9b33a14cec_SeqId_34_ 2023-10-31 05:54:47,033 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__rmiobo91mbeq60t2sj8chv4n14so9ri4r2546tc1ivfst3ctfortusrt15g1ba01/family1/dce4c18a40534cb7a69135b887c9812a into f22d093a048d2c7989ada8d66d0a76fb/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/0c217e53326b4bbba80ebb9b33a14cec_SeqId_34_ - updating store file list. 2023-10-31 05:54:47,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__dnp1oujumurrpctbk9bakf2h88dl8lv77hu9g81svou77c3813t3bdc4a6905l0j/family1/9082b279610c417bad9943aaf36e8d7d as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/ab2021247177473c980e9b449b86bc33_SeqId_34_ 2023-10-31 05:54:47,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__dnp1oujumurrpctbk9bakf2h88dl8lv77hu9g81svou77c3813t3bdc4a6905l0j/family1/9082b279610c417bad9943aaf36e8d7d into b7e12c6f039ff414ef8eee79c79535bf/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/ab2021247177473c980e9b449b86bc33_SeqId_34_ - updating store file list. 2023-10-31 05:54:47,036 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/0c217e53326b4bbba80ebb9b33a14cec_SeqId_34_ into f22d093a048d2c7989ada8d66d0a76fb/family1 2023-10-31 05:54:47,036 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__rmiobo91mbeq60t2sj8chv4n14so9ri4r2546tc1ivfst3ctfortusrt15g1ba01/family1/dce4c18a40534cb7a69135b887c9812a into f22d093a048d2c7989ada8d66d0a76fb/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/0c217e53326b4bbba80ebb9b33a14cec_SeqId_34_) 2023-10-31 05:54:47,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__rmiobo91mbeq60t2sj8chv4n14so9ri4r2546tc1ivfst3ctfortusrt15g1ba01/family1/dce4c18a40534cb7a69135b887c9812a 2023-10-31 05:54:47,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/ab2021247177473c980e9b449b86bc33_SeqId_34_ into b7e12c6f039ff414ef8eee79c79535bf/family1 2023-10-31 05:54:47,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__dnp1oujumurrpctbk9bakf2h88dl8lv77hu9g81svou77c3813t3bdc4a6905l0j/family1/9082b279610c417bad9943aaf36e8d7d into b7e12c6f039ff414ef8eee79c79535bf/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/ab2021247177473c980e9b449b86bc33_SeqId_34_) 2023-10-31 05:54:47,038 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:47,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testCompactionWithHFileLink__dnp1oujumurrpctbk9bakf2h88dl8lv77hu9g81svou77c3813t3bdc4a6905l0j/family1/9082b279610c417bad9943aaf36e8d7d 2023-10-31 05:54:47,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:47,039 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:47,040 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023103197580ffd55b3462f885c5e51c2f01fb0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023103197580ffd55b3462f885c5e51c2f01fb0 2023-10-31 05:54:47,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-31 05:54:47,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(1912): b7e12c6f039ff414ef8eee79c79535bf/family1 is initiating minor compaction (all files) 2023-10-31 05:54:47,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6d3a1bb2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-31 05:54:47,041 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231031e21644beb17b4d7c976028bcb5a65f95 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231031e21644beb17b4d7c976028bcb5a65f95 2023-10-31 05:54:47,042 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231031f551a2d3e4514b26b0aa311de217e343 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231031f551a2d3e4514b26b0aa311de217e343 2023-10-31 05:54:47,042 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231031 table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:47,042 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231031f574ec4e23004a7db1656ea9f05e6fd4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231031f574ec4e23004a7db1656ea9f05e6fd4 2023-10-31 05:54:47,042 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-31 05:54:47,043 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231031' 2023-10-31 05:54:47,043 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:47,043 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:47,044 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310312afb309d45a54170b221abc86bcc0174 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310312afb309d45a54170b221abc86bcc0174 2023-10-31 05:54:47,045 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310314789d74ddb804183aa48a5973381545f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310314789d74ddb804183aa48a5973381545f 2023-10-31 05:54:47,045 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310314f9e0582898040b697e45d0aee7063da to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310314f9e0582898040b697e45d0aee7063da 2023-10-31 05:54:47,046 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231031e8b7131d0e614ceb9b6e097ce224bef3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231031e8b7131d0e614ceb9b6e097ce224bef3 2023-10-31 05:54:47,046 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-31 05:54:47,046 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231031' 2023-10-31 05:54:47,046 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231031 for table='testCompactionWithHFileLink' and column='family1' 2023-10-31 05:54:47,046 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-31 05:54:47,049 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:47,053 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:47,057 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:47,058 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:47,063 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:47,064 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:47,078 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=286 (was 237) - Thread LEAK? -, OpenFileDescriptor=761 (was 597) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=120 (was 161), ProcessCount=169 (was 169), AvailableMemoryMB=1248 (was 1329) 2023-10-31 05:54:47,089 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=286, OpenFileDescriptor=761, MaxFileDescriptor=60000, SystemLoadAverage=120, ProcessCount=169, AvailableMemoryMB=1248 2023-10-31 05:54:47,094 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-10-31 05:54:47,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-10-31 05:54:47,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-31 05:54:47,101 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-31 05:54:47,101 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/.tmp/family2/05d0e36a568d49748110a7afb445427d as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/05d0e36a568d49748110a7afb445427d 2023-10-31 05:54:47,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-10-31 05:54:47,105 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in eb42a9600adc7511b8ec2d129b0a1882/family2 of eb42a9600adc7511b8ec2d129b0a1882 into 05d0e36a568d49748110a7afb445427d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:54:47,105 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:54:47,105 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882., storeName=eb42a9600adc7511b8ec2d129b0a1882/family2, priority=12, startTime=1698731685822; duration=1sec 2023-10-31 05:54:47,105 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-31 05:54:47,105 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegion(2259): Starting compaction of b7e12c6f039ff414ef8eee79c79535bf/family1 in testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:47,105 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-9287dde0b3254eabb55ecc6bdad2e400, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-afbea286f86d4b80bab44278800e282b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-a2fb9d8b1f8a40cba28e527b329e2d26, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-fd84e1bae15d49e4817ad9d83202640c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/ab2021247177473c980e9b449b86bc33_SeqId_34_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp, totalSize=28.9 K 2023-10-31 05:54:47,106 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-9287dde0b3254eabb55ecc6bdad2e400, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663363 2023-10-31 05:54:47,107 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-afbea286f86d4b80bab44278800e282b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664771 2023-10-31 05:54:47,107 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-a2fb9d8b1f8a40cba28e527b329e2d26, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666210 2023-10-31 05:54:47,107 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-fd84e1bae15d49e4817ad9d83202640c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668028 2023-10-31 05:54:47,108 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting ab2021247177473c980e9b449b86bc33_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698731663363 2023-10-31 05:54:47,119 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] throttle.PressureAwareThroughputController(145): b7e12c6f039ff414ef8eee79c79535bf#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:47,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-31 05:54:47,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-31 05:54:47,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-e86ac80eb5054a9b9e44995d26622187, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-ddafac5cbaab41e7ac9bff616f08a090, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-5c9df285c28f416ba2805ae46ec55263, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-bba13718c93844f2abd2fe349febfec3] to archive 2023-10-31 05:54:47,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-10-31 05:54:47,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:47,209 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:54:47,209 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-10-31 05:54:47,210 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:54:47,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-31 05:54:47,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-e86ac80eb5054a9b9e44995d26622187 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-e86ac80eb5054a9b9e44995d26622187 2023-10-31 05:54:47,213 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:54:47,213 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99 2023-10-31 05:54:47,213 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c 2023-10-31 05:54:47,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-ddafac5cbaab41e7ac9bff616f08a090 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-ddafac5cbaab41e7ac9bff616f08a090 2023-10-31 05:54:47,213 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885 empty. 2023-10-31 05:54:47,213 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99 empty. 2023-10-31 05:54:47,213 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c empty. 2023-10-31 05:54:47,213 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:54:47,213 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c 2023-10-31 05:54:47,214 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99 2023-10-31 05:54:47,214 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-10-31 05:54:47,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-5c9df285c28f416ba2805ae46ec55263 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-5c9df285c28f416ba2805ae46ec55263 2023-10-31 05:54:47,215 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-bba13718c93844f2abd2fe349febfec3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/family2/testCompactionWithHFileLink=eb42a9600adc7511b8ec2d129b0a1882-bba13718c93844f2abd2fe349febfec3 2023-10-31 05:54:47,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-31 05:54:47,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-31 05:54:47,587 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-10-31 05:54:47,621 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-10-31 05:54:47,622 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 87e435865246ef33e92819389f9c177c, NAME => 'ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:54:47,622 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8d6401043828af0dc71fdb666c576f99, NAME => 'ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:54:47,622 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7e09392ae4cf8022f3e80e0b0d3a1885, NAME => 'ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:54:47,626 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:47,626 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 8d6401043828af0dc71fdb666c576f99, disabling compactions & flushes 2023-10-31 05:54:47,626 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:47,627 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:47,627 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. after waiting 0 ms 2023-10-31 05:54:47,627 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:47,627 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:47,627 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:54:47,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-31 05:54:47,941 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family1/bcbd2fee5dbb4f688be166e7d8d7f2d3 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/bcbd2fee5dbb4f688be166e7d8d7f2d3 2023-10-31 05:54:47,948 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in b7e12c6f039ff414ef8eee79c79535bf/family1 of b7e12c6f039ff414ef8eee79c79535bf into bcbd2fee5dbb4f688be166e7d8d7f2d3(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:54:47,948 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:47,948 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698731687041; duration=0sec 2023-10-31 05:54:47,948 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-31 05:54:47,949 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-31 05:54:47,952 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-31 05:54:47,952 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1912): f22d093a048d2c7989ada8d66d0a76fb/family2 is initiating minor compaction (all files) 2023-10-31 05:54:47,952 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f22d093a048d2c7989ada8d66d0a76fb/family2 in testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:54:47,953 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-b0d609119ea84277bac801323aacb747, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-97299919220640efbaaae032eff206a1, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-997efb8497c94665857d3ef62b776dc2, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-ee997ecbcaab423fae024542830ba6a0] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp, totalSize=20.4 K 2023-10-31 05:54:47,953 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-b0d609119ea84277bac801323aacb747, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663361 2023-10-31 05:54:47,954 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-97299919220640efbaaae032eff206a1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664770 2023-10-31 05:54:47,954 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family1/78a7e8f039784862a62aeeb1873e178f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/78a7e8f039784862a62aeeb1873e178f 2023-10-31 05:54:47,955 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-997efb8497c94665857d3ef62b776dc2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666209 2023-10-31 05:54:47,956 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-ee997ecbcaab423fae024542830ba6a0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668027 2023-10-31 05:54:47,960 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f22d093a048d2c7989ada8d66d0a76fb/family1 of f22d093a048d2c7989ada8d66d0a76fb into 78a7e8f039784862a62aeeb1873e178f(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:54:47,960 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:47,960 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb., storeName=f22d093a048d2c7989ada8d66d0a76fb/family1, priority=12, startTime=1698731685908; duration=1sec 2023-10-31 05:54:47,960 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-31 05:54:47,960 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-31 05:54:47,963 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-31 05:54:47,963 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1912): b7e12c6f039ff414ef8eee79c79535bf/family2 is initiating minor compaction (all files) 2023-10-31 05:54:47,963 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b7e12c6f039ff414ef8eee79c79535bf/family2 in testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:54:47,963 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-85100bf9ebc14d4eb9777c58d74f5795, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-4e2a6984cb3c4c6da0b331506a2f6e47, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-6c218372c41a45eba43add83f759fd84, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-dfe68341782842c79beeb904a2e7fefb] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp, totalSize=20.4 K 2023-10-31 05:54:47,964 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-85100bf9ebc14d4eb9777c58d74f5795, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731663363 2023-10-31 05:54:47,964 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-4e2a6984cb3c4c6da0b331506a2f6e47, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731664771 2023-10-31 05:54:47,965 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-6c218372c41a45eba43add83f759fd84, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731666210 2023-10-31 05:54:47,965 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-dfe68341782842c79beeb904a2e7fefb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731668028 2023-10-31 05:54:47,969 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] throttle.PressureAwareThroughputController(145): f22d093a048d2c7989ada8d66d0a76fb#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-31 05:54:47,979 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): b7e12c6f039ff414ef8eee79c79535bf#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-31 05:54:48,002 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:54:48,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-2774acb1012f42999a4abecb50e157bb, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-7a355f9f198d415d998b610b1810291f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-73a7ba34b5a648c08bbb39fde60a690c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-d0d514f5e62f4c999dee316ccfc18d3c] to archive 2023-10-31 05:54:48,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:48,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-2774acb1012f42999a4abecb50e157bb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-2774acb1012f42999a4abecb50e157bb 2023-10-31 05:54:48,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-7a355f9f198d415d998b610b1810291f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-7a355f9f198d415d998b610b1810291f 2023-10-31 05:54:48,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-73a7ba34b5a648c08bbb39fde60a690c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-73a7ba34b5a648c08bbb39fde60a690c 2023-10-31 05:54:48,016 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-d0d514f5e62f4c999dee316ccfc18d3c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family1/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-d0d514f5e62f4c999dee316ccfc18d3c 2023-10-31 05:54:48,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-9287dde0b3254eabb55ecc6bdad2e400, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-afbea286f86d4b80bab44278800e282b, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-a2fb9d8b1f8a40cba28e527b329e2d26, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-fd84e1bae15d49e4817ad9d83202640c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/ab2021247177473c980e9b449b86bc33_SeqId_34_] to archive 2023-10-31 05:54:48,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:48,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-9287dde0b3254eabb55ecc6bdad2e400 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-9287dde0b3254eabb55ecc6bdad2e400 2023-10-31 05:54:48,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-afbea286f86d4b80bab44278800e282b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-afbea286f86d4b80bab44278800e282b 2023-10-31 05:54:48,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-a2fb9d8b1f8a40cba28e527b329e2d26 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-a2fb9d8b1f8a40cba28e527b329e2d26 2023-10-31 05:54:48,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-fd84e1bae15d49e4817ad9d83202640c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-fd84e1bae15d49e4817ad9d83202640c 2023-10-31 05:54:48,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/ab2021247177473c980e9b449b86bc33_SeqId_34_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family1/ab2021247177473c980e9b449b86bc33_SeqId_34_ 2023-10-31 05:54:48,027 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:48,027 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:48,027 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 87e435865246ef33e92819389f9c177c, disabling compactions & flushes 2023-10-31 05:54:48,027 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 7e09392ae4cf8022f3e80e0b0d3a1885, disabling compactions & flushes 2023-10-31 05:54:48,027 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:48,027 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:48,027 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:48,027 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. after waiting 0 ms 2023-10-31 05:54:48,027 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:48,027 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:48,028 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. after waiting 0 ms 2023-10-31 05:54:48,028 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:48,028 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:48,028 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:54:48,028 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:48,028 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:54:48,029 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:54:48,030 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698731688030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731688030"}]},"ts":"1698731688030"} 2023-10-31 05:54:48,030 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698731688030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731688030"}]},"ts":"1698731688030"} 2023-10-31 05:54:48,030 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698731688030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731688030"}]},"ts":"1698731688030"} 2023-10-31 05:54:48,032 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-31 05:54:48,033 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:54:48,033 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731688033"}]},"ts":"1698731688033"} 2023-10-31 05:54:48,034 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-10-31 05:54:48,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7e09392ae4cf8022f3e80e0b0d3a1885, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8d6401043828af0dc71fdb666c576f99, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=87e435865246ef33e92819389f9c177c, ASSIGN}] 2023-10-31 05:54:48,038 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8d6401043828af0dc71fdb666c576f99, ASSIGN 2023-10-31 05:54:48,038 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7e09392ae4cf8022f3e80e0b0d3a1885, ASSIGN 2023-10-31 05:54:48,038 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=87e435865246ef33e92819389f9c177c, ASSIGN 2023-10-31 05:54:48,039 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7e09392ae4cf8022f3e80e0b0d3a1885, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:54:48,039 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8d6401043828af0dc71fdb666c576f99, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:54:48,039 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=87e435865246ef33e92819389f9c177c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:54:48,193 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8d6401043828af0dc71fdb666c576f99, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:48,193 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=87e435865246ef33e92819389f9c177c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:48,193 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7e09392ae4cf8022f3e80e0b0d3a1885, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:48,194 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698731688193"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731688193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731688193"}]},"ts":"1698731688193"} 2023-10-31 05:54:48,194 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698731688193"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731688193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731688193"}]},"ts":"1698731688193"} 2023-10-31 05:54:48,194 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698731688193"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731688193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731688193"}]},"ts":"1698731688193"} 2023-10-31 05:54:48,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 8d6401043828af0dc71fdb666c576f99, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:48,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 7e09392ae4cf8022f3e80e0b0d3a1885, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:48,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure 87e435865246ef33e92819389f9c177c, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:54:48,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-31 05:54:48,350 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:48,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:48,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8d6401043828af0dc71fdb666c576f99, NAME => 'ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99.', STARTKEY => '1', ENDKEY => '2'} 2023-10-31 05:54:48,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 8d6401043828af0dc71fdb666c576f99 2023-10-31 05:54:48,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:48,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8d6401043828af0dc71fdb666c576f99 2023-10-31 05:54:48,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8d6401043828af0dc71fdb666c576f99 2023-10-31 05:54:48,354 INFO [StoreOpener-8d6401043828af0dc71fdb666c576f99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8d6401043828af0dc71fdb666c576f99 2023-10-31 05:54:48,355 DEBUG [StoreOpener-8d6401043828af0dc71fdb666c576f99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1 2023-10-31 05:54:48,355 DEBUG [StoreOpener-8d6401043828af0dc71fdb666c576f99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1 2023-10-31 05:54:48,356 INFO [StoreOpener-8d6401043828af0dc71fdb666c576f99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d6401043828af0dc71fdb666c576f99 columnFamilyName family1 2023-10-31 05:54:48,357 INFO [StoreOpener-8d6401043828af0dc71fdb666c576f99-1] regionserver.HStore(310): Store=8d6401043828af0dc71fdb666c576f99/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:48,357 INFO [StoreOpener-8d6401043828af0dc71fdb666c576f99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8d6401043828af0dc71fdb666c576f99 2023-10-31 05:54:48,358 DEBUG [StoreOpener-8d6401043828af0dc71fdb666c576f99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2 2023-10-31 05:54:48,358 DEBUG [StoreOpener-8d6401043828af0dc71fdb666c576f99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2 2023-10-31 05:54:48,359 INFO [StoreOpener-8d6401043828af0dc71fdb666c576f99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d6401043828af0dc71fdb666c576f99 columnFamilyName family2 2023-10-31 05:54:48,360 INFO [StoreOpener-8d6401043828af0dc71fdb666c576f99-1] regionserver.HStore(310): Store=8d6401043828af0dc71fdb666c576f99/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:48,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99 2023-10-31 05:54:48,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99 2023-10-31 05:54:48,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:54:48,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8d6401043828af0dc71fdb666c576f99 2023-10-31 05:54:48,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:54:48,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8d6401043828af0dc71fdb666c576f99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65657281, jitterRate=-0.021630272269248962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:54:48,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:54:48,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99., pid=109, masterSystemTime=1698731688350 2023-10-31 05:54:48,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:48,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:48,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:48,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7e09392ae4cf8022f3e80e0b0d3a1885, NAME => 'ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885.', STARTKEY => '', ENDKEY => '1'} 2023-10-31 05:54:48,369 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8d6401043828af0dc71fdb666c576f99, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:48,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:54:48,369 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698731688369"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731688369"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731688369"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731688369"}]},"ts":"1698731688369"} 2023-10-31 05:54:48,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:48,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:54:48,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:54:48,370 INFO [StoreOpener-7e09392ae4cf8022f3e80e0b0d3a1885-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:54:48,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-31 05:54:48,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 8d6401043828af0dc71fdb666c576f99, server=jenkins-hbase20.apache.org,43723,1698731565849 in 173 msec 2023-10-31 05:54:48,372 DEBUG [StoreOpener-7e09392ae4cf8022f3e80e0b0d3a1885-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1 2023-10-31 05:54:48,372 DEBUG [StoreOpener-7e09392ae4cf8022f3e80e0b0d3a1885-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1 2023-10-31 05:54:48,373 INFO [StoreOpener-7e09392ae4cf8022f3e80e0b0d3a1885-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e09392ae4cf8022f3e80e0b0d3a1885 columnFamilyName family1 2023-10-31 05:54:48,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8d6401043828af0dc71fdb666c576f99, ASSIGN in 336 msec 2023-10-31 05:54:48,374 INFO [StoreOpener-7e09392ae4cf8022f3e80e0b0d3a1885-1] regionserver.HStore(310): Store=7e09392ae4cf8022f3e80e0b0d3a1885/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:48,374 INFO [StoreOpener-7e09392ae4cf8022f3e80e0b0d3a1885-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:54:48,375 DEBUG [StoreOpener-7e09392ae4cf8022f3e80e0b0d3a1885-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2 2023-10-31 05:54:48,375 DEBUG [StoreOpener-7e09392ae4cf8022f3e80e0b0d3a1885-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2 2023-10-31 05:54:48,375 INFO [StoreOpener-7e09392ae4cf8022f3e80e0b0d3a1885-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e09392ae4cf8022f3e80e0b0d3a1885 columnFamilyName family2 2023-10-31 05:54:48,376 INFO [StoreOpener-7e09392ae4cf8022f3e80e0b0d3a1885-1] regionserver.HStore(310): Store=7e09392ae4cf8022f3e80e0b0d3a1885/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:48,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:54:48,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:54:48,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:54:48,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:54:48,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:54:48,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7e09392ae4cf8022f3e80e0b0d3a1885; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64407369, jitterRate=-0.040255412459373474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:54:48,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:54:48,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885., pid=110, masterSystemTime=1698731688350 2023-10-31 05:54:48,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:48,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:48,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:48,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87e435865246ef33e92819389f9c177c, NAME => 'ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c.', STARTKEY => '2', ENDKEY => ''} 2023-10-31 05:54:48,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 87e435865246ef33e92819389f9c177c 2023-10-31 05:54:48,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:54:48,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 87e435865246ef33e92819389f9c177c 2023-10-31 05:54:48,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 87e435865246ef33e92819389f9c177c 2023-10-31 05:54:48,387 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7e09392ae4cf8022f3e80e0b0d3a1885, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:48,388 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698731688387"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731688387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731688387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731688387"}]},"ts":"1698731688387"} 2023-10-31 05:54:48,388 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/.tmp/family2/0cd93c66cd9447a9bd2f7da2038893f7 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/0cd93c66cd9447a9bd2f7da2038893f7 2023-10-31 05:54:48,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=106 2023-10-31 05:54:48,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 7e09392ae4cf8022f3e80e0b0d3a1885, server=jenkins-hbase20.apache.org,43723,1698731565849 in 191 msec 2023-10-31 05:54:48,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7e09392ae4cf8022f3e80e0b0d3a1885, ASSIGN in 355 msec 2023-10-31 05:54:48,393 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f22d093a048d2c7989ada8d66d0a76fb/family2 of f22d093a048d2c7989ada8d66d0a76fb into 0cd93c66cd9447a9bd2f7da2038893f7(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:54:48,393 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:54:48,393 INFO [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb., storeName=f22d093a048d2c7989ada8d66d0a76fb/family2, priority=12, startTime=1698731685908; duration=0sec 2023-10-31 05:54:48,393 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-31 05:54:48,393 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-10-31 05:54:48,394 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-31 05:54:48,394 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-31 05:54:48,394 DEBUG [RS:0;jenkins-hbase20:43723-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. because compaction request was cancelled 2023-10-31 05:54:48,395 INFO [StoreOpener-87e435865246ef33e92819389f9c177c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 87e435865246ef33e92819389f9c177c 2023-10-31 05:54:48,397 DEBUG [StoreOpener-87e435865246ef33e92819389f9c177c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1 2023-10-31 05:54:48,397 DEBUG [StoreOpener-87e435865246ef33e92819389f9c177c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1 2023-10-31 05:54:48,397 INFO [StoreOpener-87e435865246ef33e92819389f9c177c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87e435865246ef33e92819389f9c177c columnFamilyName family1 2023-10-31 05:54:48,398 INFO [StoreOpener-87e435865246ef33e92819389f9c177c-1] regionserver.HStore(310): Store=87e435865246ef33e92819389f9c177c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:48,399 INFO [StoreOpener-87e435865246ef33e92819389f9c177c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 87e435865246ef33e92819389f9c177c 2023-10-31 05:54:48,400 DEBUG [StoreOpener-87e435865246ef33e92819389f9c177c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2 2023-10-31 05:54:48,400 DEBUG [StoreOpener-87e435865246ef33e92819389f9c177c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2 2023-10-31 05:54:48,400 INFO [StoreOpener-87e435865246ef33e92819389f9c177c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87e435865246ef33e92819389f9c177c columnFamilyName family2 2023-10-31 05:54:48,401 INFO [StoreOpener-87e435865246ef33e92819389f9c177c-1] regionserver.HStore(310): Store=87e435865246ef33e92819389f9c177c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:54:48,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c 2023-10-31 05:54:48,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c 2023-10-31 05:54:48,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:54:48,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 87e435865246ef33e92819389f9c177c 2023-10-31 05:54:48,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:54:48,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 87e435865246ef33e92819389f9c177c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75208762, jitterRate=0.12069788575172424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:54:48,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:54:48,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c., pid=111, masterSystemTime=1698731688350 2023-10-31 05:54:48,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:48,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:48,408 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=87e435865246ef33e92819389f9c177c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:48,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-b0d609119ea84277bac801323aacb747, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-97299919220640efbaaae032eff206a1, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-997efb8497c94665857d3ef62b776dc2, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-ee997ecbcaab423fae024542830ba6a0] to archive 2023-10-31 05:54:48,408 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698731688407"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731688407"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731688407"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731688407"}]},"ts":"1698731688407"} 2023-10-31 05:54:48,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:48,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-b0d609119ea84277bac801323aacb747 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-b0d609119ea84277bac801323aacb747 2023-10-31 05:54:48,410 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=108 2023-10-31 05:54:48,410 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure 87e435865246ef33e92819389f9c177c, server=jenkins-hbase20.apache.org,43723,1698731565849 in 210 msec 2023-10-31 05:54:48,411 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-97299919220640efbaaae032eff206a1 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-97299919220640efbaaae032eff206a1 2023-10-31 05:54:48,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=105 2023-10-31 05:54:48,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=87e435865246ef33e92819389f9c177c, ASSIGN in 374 msec 2023-10-31 05:54:48,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-997efb8497c94665857d3ef62b776dc2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-997efb8497c94665857d3ef62b776dc2 2023-10-31 05:54:48,412 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:54:48,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731688412"}]},"ts":"1698731688412"} 2023-10-31 05:54:48,413 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-ee997ecbcaab423fae024542830ba6a0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/family2/testCompactionWithHFileLink=f22d093a048d2c7989ada8d66d0a76fb-ee997ecbcaab423fae024542830ba6a0 2023-10-31 05:54:48,413 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-10-31 05:54:48,414 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:54:48,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2090 sec 2023-10-31 05:54:48,808 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/.tmp/family2/b2cab69d14594bfba29adf2bc5c7e3e0 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/b2cab69d14594bfba29adf2bc5c7e3e0 2023-10-31 05:54:48,814 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b7e12c6f039ff414ef8eee79c79535bf/family2 of b7e12c6f039ff414ef8eee79c79535bf into b2cab69d14594bfba29adf2bc5c7e3e0(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:54:48,814 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:54:48,814 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf., storeName=b7e12c6f039ff414ef8eee79c79535bf/family2, priority=12, startTime=1698731685973; duration=0sec 2023-10-31 05:54:48,815 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:54:48,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-85100bf9ebc14d4eb9777c58d74f5795, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-4e2a6984cb3c4c6da0b331506a2f6e47, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-6c218372c41a45eba43add83f759fd84, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-dfe68341782842c79beeb904a2e7fefb] to archive 2023-10-31 05:54:48,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:48,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-85100bf9ebc14d4eb9777c58d74f5795 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-85100bf9ebc14d4eb9777c58d74f5795 2023-10-31 05:54:48,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-4e2a6984cb3c4c6da0b331506a2f6e47 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-4e2a6984cb3c4c6da0b331506a2f6e47 2023-10-31 05:54:48,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-6c218372c41a45eba43add83f759fd84 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-6c218372c41a45eba43add83f759fd84 2023-10-31 05:54:48,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-dfe68341782842c79beeb904a2e7fefb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/family2/testCompactionWithHFileLink=b7e12c6f039ff414ef8eee79c79535bf-dfe68341782842c79beeb904a2e7fefb 2023-10-31 05:54:49,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-31 05:54:49,319 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-10-31 05:54:49,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:49,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:49,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:49,334 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:49,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-31 05:54:49,336 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-31 05:54:49,336 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:49,336 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-31 05:54:49,336 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-31 05:54:49,337 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:49,337 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:49,338 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:49,338 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:49,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:49,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:49,339 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:49,339 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:49,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:49,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:49,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:49,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:49,340 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-31 05:54:49,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-31 05:54:49,340 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-31 05:54:49,340 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:49,340 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-31 05:54:49,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:49,341 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. started... 2023-10-31 05:54:49,344 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8d6401043828af0dc71fdb666c576f99 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-31 05:54:49,344 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:54:49,344 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:49,344 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:49,344 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. started... 2023-10-31 05:54:49,344 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:49,344 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. started... 2023-10-31 05:54:49,344 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7e09392ae4cf8022f3e80e0b0d3a1885 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-31 05:54:49,344 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 87e435865246ef33e92819389f9c177c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-31 05:54:49,362 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103164304eef9ae84bd39ec00cf6630512e6 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023103164304eef9ae84bd39ec00cf6630512e6 2023-10-31 05:54:49,767 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/67269c6c01af4278a3a30b5e1260bab5 2023-10-31 05:54:49,768 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031ad8547b0262949afbfcda86a075b957e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231031ad8547b0262949afbfcda86a075b957e 2023-10-31 05:54:49,768 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310310c4f0ae2fdf8468088ea69780da47260 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310310c4f0ae2fdf8468088ea69780da47260 2023-10-31 05:54:49,774 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/f0b497bc27684db69e017a0b00501243 2023-10-31 05:54:49,789 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310314b890a537269449e8e7b9a8a22dffbef to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202310314b890a537269449e8e7b9a8a22dffbef 2023-10-31 05:54:50,175 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/672344315d0e4f8db8cf6a4d3ac5ac1a 2023-10-31 05:54:50,186 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031e171609f1c644180bcf90c3db66c5e98 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231031e171609f1c644180bcf90c3db66c5e98 2023-10-31 05:54:50,195 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/95e846c0b0bf40b0936c9f119f19e91f 2023-10-31 05:54:50,199 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/f0b497bc27684db69e017a0b00501243 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/f0b497bc27684db69e017a0b00501243 2023-10-31 05:54:50,202 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/f0b497bc27684db69e017a0b00501243, entries=4, sequenceid=5, filesize=5.4 K 2023-10-31 05:54:50,203 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/95e846c0b0bf40b0936c9f119f19e91f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/95e846c0b0bf40b0936c9f119f19e91f 2023-10-31 05:54:50,206 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/95e846c0b0bf40b0936c9f119f19e91f, entries=2, sequenceid=5, filesize=5.1 K 2023-10-31 05:54:50,207 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8d6401043828af0dc71fdb666c576f99 in 863ms, sequenceid=5, compaction requested=false 2023-10-31 05:54:50,207 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-10-31 05:54:50,207 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:54:50,208 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:50,208 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:54:50,596 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/a61d8264223b4ce1bf7335257ecf4d91 2023-10-31 05:54:50,601 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/67269c6c01af4278a3a30b5e1260bab5 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/67269c6c01af4278a3a30b5e1260bab5 2023-10-31 05:54:50,603 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310315914dd761de24ef189b14680c4552ecf to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310315914dd761de24ef189b14680c4552ecf 2023-10-31 05:54:50,607 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/67269c6c01af4278a3a30b5e1260bab5, entries=4, sequenceid=5, filesize=5.4 K 2023-10-31 05:54:50,608 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/a61d8264223b4ce1bf7335257ecf4d91 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a61d8264223b4ce1bf7335257ecf4d91 2023-10-31 05:54:50,614 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a61d8264223b4ce1bf7335257ecf4d91, entries=2, sequenceid=5, filesize=5.1 K 2023-10-31 05:54:50,615 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 87e435865246ef33e92819389f9c177c in 1271ms, sequenceid=5, compaction requested=false 2023-10-31 05:54:50,619 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:54:50,619 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:50,619 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:54:51,022 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/ef5b9f2b1177432286435868e16612d4 2023-10-31 05:54:51,035 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/672344315d0e4f8db8cf6a4d3ac5ac1a as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/672344315d0e4f8db8cf6a4d3ac5ac1a 2023-10-31 05:54:51,049 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/672344315d0e4f8db8cf6a4d3ac5ac1a, entries=4, sequenceid=5, filesize=5.4 K 2023-10-31 05:54:51,050 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/ef5b9f2b1177432286435868e16612d4 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/ef5b9f2b1177432286435868e16612d4 2023-10-31 05:54:51,058 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/ef5b9f2b1177432286435868e16612d4, entries=2, sequenceid=5, filesize=5.1 K 2023-10-31 05:54:51,059 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7e09392ae4cf8022f3e80e0b0d3a1885 in 1715ms, sequenceid=5, compaction requested=false 2023-10-31 05:54:51,059 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:54:51,059 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:51,061 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:54:51,061 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:54:51,061 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,061 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-31 05:54:51,061 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-31 05:54:51,062 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,062 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:51,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-31 05:54:51,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7792ff79[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:51,065 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-31 05:54:51,065 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:51,065 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:51,065 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:51,066 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:51,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:51,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:51,066 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-31 05:54:51,066 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-31 05:54:51,066 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:51,066 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,066 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:51,067 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-31 05:54:51,067 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:51,068 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-31 05:54:51,068 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:51,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-31 05:54:51,071 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-31 05:54:51,071 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:51,071 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:51,071 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-31 05:54:51,071 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:51,072 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:51,072 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:51,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:51,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:51,074 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:51,075 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:51,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,076 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:51,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:51,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,079 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:51,079 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:51,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:51,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:51,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:51,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:51,080 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,080 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:51,080 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:51,080 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,080 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:51,080 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:51,080 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:51,080 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:51,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-31 05:54:51,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:51,080 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:51,081 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:51,181 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:51,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:51,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:51,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:51,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:51,196 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:51,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:51,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-31 05:54:51,201 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-31 05:54:51,201 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:51,201 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-31 05:54:51,201 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-31 05:54:51,201 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:51,201 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:51,202 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:51,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:51,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:51,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:51,203 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:51,204 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:51,204 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:51,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:51,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:51,204 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-31 05:54:51,206 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-31 05:54:51,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-31 05:54:51,206 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-31 05:54:51,206 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:51,206 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-31 05:54:51,207 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:51,207 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. started... 2023-10-31 05:54:51,207 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8d6401043828af0dc71fdb666c576f99 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-31 05:54:51,210 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:51,210 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. started... 2023-10-31 05:54:51,210 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 87e435865246ef33e92819389f9c177c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-31 05:54:51,211 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:54:51,211 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:51,211 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:51,211 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. started... 2023-10-31 05:54:51,211 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7e09392ae4cf8022f3e80e0b0d3a1885 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-31 05:54:51,650 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103112bd0cafd8dc487c9d7d8f6688bdb0fa to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023103112bd0cafd8dc487c9d7d8f6688bdb0fa 2023-10-31 05:54:51,651 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310312ee76735c8074b13bc3672720f1df0f0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310312ee76735c8074b13bc3672720f1df0f0 2023-10-31 05:54:51,659 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031b8ec1e186a724c0b996a744b0d4b67ae to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231031b8ec1e186a724c0b996a744b0d4b67ae 2023-10-31 05:54:51,669 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/b40ba55bdea1465ba9c94323692fc87c 2023-10-31 05:54:51,671 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/b184f2b4340943d694ab04c1392e72d6 2023-10-31 05:54:51,678 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/c94f3f247e814f8fb50f20d604d33436 2023-10-31 05:54:51,760 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310311a4749eb9c764efba9d11a8f79d1a7f9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310311a4749eb9c764efba9d11a8f79d1a7f9 2023-10-31 05:54:51,782 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/4d0a5075c40e40c5bb245e73553156fa 2023-10-31 05:54:51,787 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/b184f2b4340943d694ab04c1392e72d6 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/b184f2b4340943d694ab04c1392e72d6 2023-10-31 05:54:51,791 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/b184f2b4340943d694ab04c1392e72d6, entries=4, sequenceid=9, filesize=5.4 K 2023-10-31 05:54:51,799 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/4d0a5075c40e40c5bb245e73553156fa as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/4d0a5075c40e40c5bb245e73553156fa 2023-10-31 05:54:51,806 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/4d0a5075c40e40c5bb245e73553156fa, entries=2, sequenceid=9, filesize=5.1 K 2023-10-31 05:54:51,806 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 87e435865246ef33e92819389f9c177c in 596ms, sequenceid=9, compaction requested=false 2023-10-31 05:54:51,807 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:54:51,807 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:51,807 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:54:52,148 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031f0fa257cb53a490d819ac5889a6eda98 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231031f0fa257cb53a490d819ac5889a6eda98 2023-10-31 05:54:52,157 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031164d76c3c35142eeb83fc5ce4ce0e1ce to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231031164d76c3c35142eeb83fc5ce4ce0e1ce 2023-10-31 05:54:52,167 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/57307403f2004241bb27abd4cc9097e4 2023-10-31 05:54:52,171 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/c94f3f247e814f8fb50f20d604d33436 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/c94f3f247e814f8fb50f20d604d33436 2023-10-31 05:54:52,187 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/c94f3f247e814f8fb50f20d604d33436, entries=4, sequenceid=9, filesize=5.4 K 2023-10-31 05:54:52,193 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/57307403f2004241bb27abd4cc9097e4 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/57307403f2004241bb27abd4cc9097e4 2023-10-31 05:54:52,202 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/57307403f2004241bb27abd4cc9097e4, entries=2, sequenceid=9, filesize=5.1 K 2023-10-31 05:54:52,203 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7e09392ae4cf8022f3e80e0b0d3a1885 in 992ms, sequenceid=9, compaction requested=false 2023-10-31 05:54:52,203 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:54:52,203 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:52,203 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:54:52,556 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/4150a6f356184351a32e6c1ee0112081 2023-10-31 05:54:52,560 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/b40ba55bdea1465ba9c94323692fc87c as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/b40ba55bdea1465ba9c94323692fc87c 2023-10-31 05:54:52,564 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/b40ba55bdea1465ba9c94323692fc87c, entries=4, sequenceid=9, filesize=5.4 K 2023-10-31 05:54:52,565 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/4150a6f356184351a32e6c1ee0112081 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/4150a6f356184351a32e6c1ee0112081 2023-10-31 05:54:52,575 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/4150a6f356184351a32e6c1ee0112081, entries=2, sequenceid=9, filesize=5.1 K 2023-10-31 05:54:52,576 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8d6401043828af0dc71fdb666c576f99 in 1369ms, sequenceid=9, compaction requested=false 2023-10-31 05:54:52,576 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:54:52,577 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:52,577 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:54:52,577 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:54:52,577 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,577 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-31 05:54:52,577 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-31 05:54:52,579 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,579 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:52,579 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:52,580 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:52,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:52,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:52,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:52,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:52,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-31 05:54:52,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6df0828b[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:52,581 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-31 05:54:52,581 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:52,582 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:52,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:52,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:52,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-31 05:54:52,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-31 05:54:52,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:52,583 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,583 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:52,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-31 05:54:52,583 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,583 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-31 05:54:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:52,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:52,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:52,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-31 05:54:52,585 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-31 05:54:52,585 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:52,585 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:52,585 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-31 05:54:52,585 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:52,586 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:52,586 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:52,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:52,586 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:52,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,587 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,588 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,589 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,589 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:52,589 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:52,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:52,589 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:52,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-31 05:54:52,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:52,589 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:52,589 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:52,589 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:52,589 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:52,590 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:52,590 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:52,590 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:52,590 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:52,690 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:52,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:52,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:52,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:52,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:52,694 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:52,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:52,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-31 05:54:52,695 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-31 05:54:52,695 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:52,695 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-31 05:54:52,695 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-31 05:54:52,696 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:52,696 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:52,696 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:52,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:52,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:52,697 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-31 05:54:52,698 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-31 05:54:52,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-31 05:54:52,698 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-31 05:54:52,698 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:52,698 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-31 05:54:52,696 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,698 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:52,698 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. started... 2023-10-31 05:54:52,698 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:52,698 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:52,698 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8d6401043828af0dc71fdb666c576f99 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-31 05:54:52,699 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:52,699 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. started... 2023-10-31 05:54:52,699 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 87e435865246ef33e92819389f9c177c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-31 05:54:52,699 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:54:52,699 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:52,699 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:52,699 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. started... 2023-10-31 05:54:52,699 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7e09392ae4cf8022f3e80e0b0d3a1885 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-31 05:54:53,129 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031aae027a8aced4e92b301300396f49882 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231031aae027a8aced4e92b301300396f49882 2023-10-31 05:54:53,137 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103140fb642ef2824644b843ed9afcca6445 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023103140fb642ef2824644b843ed9afcca6445 2023-10-31 05:54:53,139 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310313037ddb3f2294a8b98959ba32b2aaa2e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310313037ddb3f2294a8b98959ba32b2aaa2e 2023-10-31 05:54:53,151 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/cd6777b0c6664b66904a9068d9c311d3 2023-10-31 05:54:53,162 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/20d1d5c8a1f8478ba685edf1d015b4c5 2023-10-31 05:54:53,200 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310315f90127c3bfa4e898abb5908dcfa55fb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310315f90127c3bfa4e898abb5908dcfa55fb 2023-10-31 05:54:53,213 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/9e25d66d26e046dba3d54b0f3b5bf5b8 2023-10-31 05:54:53,220 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/cd6777b0c6664b66904a9068d9c311d3 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/cd6777b0c6664b66904a9068d9c311d3 2023-10-31 05:54:53,224 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/cd6777b0c6664b66904a9068d9c311d3, entries=4, sequenceid=13, filesize=5.4 K 2023-10-31 05:54:53,225 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/9e25d66d26e046dba3d54b0f3b5bf5b8 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/9e25d66d26e046dba3d54b0f3b5bf5b8 2023-10-31 05:54:53,234 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/9e25d66d26e046dba3d54b0f3b5bf5b8, entries=2, sequenceid=13, filesize=5.1 K 2023-10-31 05:54:53,236 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 87e435865246ef33e92819389f9c177c in 537ms, sequenceid=13, compaction requested=true 2023-10-31 05:54:53,236 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:54:53,236 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:53,236 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:54:53,565 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/bcec8f6cfc61418db1fc72f613aece96 2023-10-31 05:54:53,591 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031cd130e1ae35a443a9e68b0277e322b9e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231031cd130e1ae35a443a9e68b0277e322b9e 2023-10-31 05:54:53,598 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103165c02b3404874632be4468ce8c040b43 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023103165c02b3404874632be4468ce8c040b43 2023-10-31 05:54:53,606 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/8d8bb16509924bb1a0baecf1685825d7 2023-10-31 05:54:53,612 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/20d1d5c8a1f8478ba685edf1d015b4c5 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/20d1d5c8a1f8478ba685edf1d015b4c5 2023-10-31 05:54:53,616 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/20d1d5c8a1f8478ba685edf1d015b4c5, entries=4, sequenceid=13, filesize=5.4 K 2023-10-31 05:54:53,617 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/8d8bb16509924bb1a0baecf1685825d7 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/8d8bb16509924bb1a0baecf1685825d7 2023-10-31 05:54:53,623 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/8d8bb16509924bb1a0baecf1685825d7, entries=2, sequenceid=13, filesize=5.1 K 2023-10-31 05:54:53,623 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7e09392ae4cf8022f3e80e0b0d3a1885 in 924ms, sequenceid=13, compaction requested=true 2023-10-31 05:54:53,623 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:54:53,624 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:53,624 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:54:53,855 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:54:53,999 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/b347f48796374b85a99f2fe467143479 2023-10-31 05:54:54,005 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/bcec8f6cfc61418db1fc72f613aece96 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/bcec8f6cfc61418db1fc72f613aece96 2023-10-31 05:54:54,008 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/bcec8f6cfc61418db1fc72f613aece96, entries=4, sequenceid=13, filesize=5.4 K 2023-10-31 05:54:54,009 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/b347f48796374b85a99f2fe467143479 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/b347f48796374b85a99f2fe467143479 2023-10-31 05:54:54,012 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/b347f48796374b85a99f2fe467143479, entries=2, sequenceid=13, filesize=5.1 K 2023-10-31 05:54:54,013 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8d6401043828af0dc71fdb666c576f99 in 1315ms, sequenceid=13, compaction requested=true 2023-10-31 05:54:54,013 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:54:54,013 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:54,013 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:54:54,013 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:54:54,013 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,013 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-31 05:54:54,013 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-31 05:54:54,014 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:54,014 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:54,014 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:54,014 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:54,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:54,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:54,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-31 05:54:54,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54061c27[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:54,015 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-31 05:54:54,015 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:54,016 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:54,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:54,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:54,016 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-31 05:54:54,016 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-31 05:54:54,016 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:54,016 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,016 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:54,017 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-31 05:54:54,017 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,017 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:54,017 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-31 05:54:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:54,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-31 05:54:54,018 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-31 05:54:54,018 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:54,019 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:54,019 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-31 05:54:54,019 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:54,019 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:54,019 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:54,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:54,019 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:54,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:54,020 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:54,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:54,021 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:54,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,022 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,022 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:54,022 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:54,022 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:54,022 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,022 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:54,022 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-31 05:54:54,022 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:54,022 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:54,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:54,022 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:54,022 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:54,023 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:54,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-31 05:54:54,023 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:54,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:54,023 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:54,123 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:54,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:54,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:54,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:54,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:54:54,127 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:54,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:54,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-31 05:54:54,129 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-31 05:54:54,129 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:54,129 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-31 05:54:54,129 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-31 05:54:54,130 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:54,130 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:54,131 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,131 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:54,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:54,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:54,131 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:54,131 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:54,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:54,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:54,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:54,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:54,132 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-31 05:54:54,132 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-31 05:54:54,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-31 05:54:54,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-31 05:54:54,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:54,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-31 05:54:54,133 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:54,133 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. started... 2023-10-31 05:54:54,133 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 87e435865246ef33e92819389f9c177c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-31 05:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. started... 2023-10-31 05:54:54,134 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8d6401043828af0dc71fdb666c576f99 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-31 05:54:54,134 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:54:54,134 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. started... 2023-10-31 05:54:54,134 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7e09392ae4cf8022f3e80e0b0d3a1885 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-31 05:54:54,555 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310312cebc3c53f314f4dbda822e60c79537d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310312cebc3c53f314f4dbda822e60c79537d 2023-10-31 05:54:54,559 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/22838d38547b403ca3d3023dad30a7a6 2023-10-31 05:54:54,561 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031bafd4f328a0640e687437857f72ae306 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231031bafd4f328a0640e687437857f72ae306 2023-10-31 05:54:54,562 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031f5045c72e1234b21b672609e1ec17f4c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231031f5045c72e1234b21b672609e1ec17f4c 2023-10-31 05:54:54,585 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310319ace3c8745f3468ca38a39e5e3e66601 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310319ace3c8745f3468ca38a39e5e3e66601 2023-10-31 05:54:54,975 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/fb4ea8be0dd94f86af3b0654248bd2d0 2023-10-31 05:54:54,976 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/18cce8af738c4317ab2bcaf7c5f450ec 2023-10-31 05:54:54,999 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/88ce15e79bf949ed99d1f392f11eddf9 2023-10-31 05:54:55,008 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/22838d38547b403ca3d3023dad30a7a6 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/22838d38547b403ca3d3023dad30a7a6 2023-10-31 05:54:55,009 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310315a781e10e2914884a2f6eae62f5c38c3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202310315a781e10e2914884a2f6eae62f5c38c3 2023-10-31 05:54:55,015 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/22838d38547b403ca3d3023dad30a7a6, entries=4, sequenceid=17, filesize=5.4 K 2023-10-31 05:54:55,017 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/88ce15e79bf949ed99d1f392f11eddf9 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/88ce15e79bf949ed99d1f392f11eddf9 2023-10-31 05:54:55,023 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/88ce15e79bf949ed99d1f392f11eddf9, entries=2, sequenceid=17, filesize=5.1 K 2023-10-31 05:54:55,025 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7e09392ae4cf8022f3e80e0b0d3a1885 in 891ms, sequenceid=17, compaction requested=true 2023-10-31 05:54:55,025 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:54:55,025 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:55,025 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:54:55,418 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/14d843be7df5453d9a195a9147234799 2023-10-31 05:54:55,420 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103126f55b2c92ba4ef6ae72d69437f40aac to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023103126f55b2c92ba4ef6ae72d69437f40aac 2023-10-31 05:54:55,423 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/fb4ea8be0dd94f86af3b0654248bd2d0 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/fb4ea8be0dd94f86af3b0654248bd2d0 2023-10-31 05:54:55,427 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/fb4ea8be0dd94f86af3b0654248bd2d0, entries=4, sequenceid=17, filesize=5.4 K 2023-10-31 05:54:55,427 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/14d843be7df5453d9a195a9147234799 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/14d843be7df5453d9a195a9147234799 2023-10-31 05:54:55,431 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/14d843be7df5453d9a195a9147234799, entries=2, sequenceid=17, filesize=5.1 K 2023-10-31 05:54:55,432 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8d6401043828af0dc71fdb666c576f99 in 1298ms, sequenceid=17, compaction requested=true 2023-10-31 05:54:55,432 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:54:55,432 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:55,432 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:54:55,826 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/a1e9be5bbbfc4503b5ebb09bcfe53a17 2023-10-31 05:54:55,831 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/18cce8af738c4317ab2bcaf7c5f450ec as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/18cce8af738c4317ab2bcaf7c5f450ec 2023-10-31 05:54:55,834 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/18cce8af738c4317ab2bcaf7c5f450ec, entries=4, sequenceid=17, filesize=5.4 K 2023-10-31 05:54:55,835 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/a1e9be5bbbfc4503b5ebb09bcfe53a17 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a1e9be5bbbfc4503b5ebb09bcfe53a17 2023-10-31 05:54:55,841 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a1e9be5bbbfc4503b5ebb09bcfe53a17, entries=2, sequenceid=17, filesize=5.1 K 2023-10-31 05:54:55,843 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 87e435865246ef33e92819389f9c177c in 1710ms, sequenceid=17, compaction requested=true 2023-10-31 05:54:55,843 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:54:55,843 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:55,843 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:54:55,843 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:54:55,843 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,843 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-31 05:54:55,843 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-31 05:54:55,844 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,844 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:55,844 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:55,845 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:55,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-31 05:54:55,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7812feaf[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:55,846 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-31 05:54:55,846 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:55,848 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:55,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:55,848 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-31 05:54:55,848 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-31 05:54:55,848 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:55,848 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,849 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:55,850 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-31 05:54:55,850 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:55,850 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-31 05:54:55,850 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:55,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:55,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:55,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:55,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:55,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:55,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:55,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:55,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-31 05:54:55,853 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-31 05:54:55,853 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:55,853 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:55,853 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-31 05:54:55,853 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:55,854 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:55,854 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:55,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:55,854 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:55,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:55,854 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:55,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:55,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:55,855 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:55,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:55,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:55,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:55,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:55,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:55,857 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-31 05:54:55,857 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:55,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-31 05:54:55,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:55,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:55,857 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:55,857 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:55,957 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:55,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:55,976 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:55,995 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:56,007 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:54:56,008 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:54:56,051 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:54:56,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-31 05:54:56,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-31 05:54:56,054 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-31 05:54:56,054 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:56,055 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-31 05:54:56,055 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-31 05:54:56,056 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:56,057 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:56,057 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:56,057 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:56,058 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,058 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:54:56,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:56,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:56,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:54:56,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:56,058 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-31 05:54:56,061 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-31 05:54:56,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-31 05:54:56,061 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-31 05:54:56,061 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:54:56,061 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-31 05:54:56,062 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:56,062 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. started... 2023-10-31 05:54:56,062 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:54:56,062 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:54:56,062 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8d6401043828af0dc71fdb666c576f99 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-31 05:54:56,062 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:56,062 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. started... 2023-10-31 05:54:56,062 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:56,062 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. started... 2023-10-31 05:54:56,062 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 87e435865246ef33e92819389f9c177c 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-31 05:54:56,062 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7e09392ae4cf8022f3e80e0b0d3a1885 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-31 05:54:56,087 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/95b6badb0d7743d6b800b93d7268366e 2023-10-31 05:54:56,098 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95b6badb0d7743d6b800b93d7268366e 2023-10-31 05:54:56,127 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/1b1c01b490fa434081c9568292ad9a90 2023-10-31 05:54:56,131 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b1c01b490fa434081c9568292ad9a90 2023-10-31 05:54:56,134 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/95b6badb0d7743d6b800b93d7268366e as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/95b6badb0d7743d6b800b93d7268366e 2023-10-31 05:54:56,142 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95b6badb0d7743d6b800b93d7268366e 2023-10-31 05:54:56,143 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/95b6badb0d7743d6b800b93d7268366e, entries=3, sequenceid=23, filesize=5.0 K 2023-10-31 05:54:56,143 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/1b1c01b490fa434081c9568292ad9a90 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/1b1c01b490fa434081c9568292ad9a90 2023-10-31 05:54:56,148 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b1c01b490fa434081c9568292ad9a90 2023-10-31 05:54:56,148 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/1b1c01b490fa434081c9568292ad9a90, entries=1, sequenceid=23, filesize=5.0 K 2023-10-31 05:54:56,148 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8d6401043828af0dc71fdb666c576f99 in 86ms, sequenceid=23, compaction requested=true 2023-10-31 05:54:56,148 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:54:56,148 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:56,148 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:54:56,484 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/d0b1d9d4db324b509a3b9414d007d642 2023-10-31 05:54:56,489 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0b1d9d4db324b509a3b9414d007d642 2023-10-31 05:54:56,491 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/2476eb1d300f4d42aae286e045549124 2023-10-31 05:54:56,495 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2476eb1d300f4d42aae286e045549124 2023-10-31 05:54:56,518 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/1fd3b994bf134c01814e9cc722dc9914 2023-10-31 05:54:56,522 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/6f1ce891de6b41108cc672cecb741c3f 2023-10-31 05:54:56,522 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fd3b994bf134c01814e9cc722dc9914 2023-10-31 05:54:56,522 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/d0b1d9d4db324b509a3b9414d007d642 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/d0b1d9d4db324b509a3b9414d007d642 2023-10-31 05:54:56,529 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f1ce891de6b41108cc672cecb741c3f 2023-10-31 05:54:56,529 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/2476eb1d300f4d42aae286e045549124 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/2476eb1d300f4d42aae286e045549124 2023-10-31 05:54:56,530 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0b1d9d4db324b509a3b9414d007d642 2023-10-31 05:54:56,530 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/d0b1d9d4db324b509a3b9414d007d642, entries=3, sequenceid=23, filesize=5.0 K 2023-10-31 05:54:56,531 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/1fd3b994bf134c01814e9cc722dc9914 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/1fd3b994bf134c01814e9cc722dc9914 2023-10-31 05:54:56,534 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2476eb1d300f4d42aae286e045549124 2023-10-31 05:54:56,534 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/2476eb1d300f4d42aae286e045549124, entries=3, sequenceid=23, filesize=5.0 K 2023-10-31 05:54:56,534 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/6f1ce891de6b41108cc672cecb741c3f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/6f1ce891de6b41108cc672cecb741c3f 2023-10-31 05:54:56,539 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fd3b994bf134c01814e9cc722dc9914 2023-10-31 05:54:56,539 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/1fd3b994bf134c01814e9cc722dc9914, entries=1, sequenceid=23, filesize=5.0 K 2023-10-31 05:54:56,539 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f1ce891de6b41108cc672cecb741c3f 2023-10-31 05:54:56,539 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/6f1ce891de6b41108cc672cecb741c3f, entries=1, sequenceid=23, filesize=5.0 K 2023-10-31 05:54:56,539 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 87e435865246ef33e92819389f9c177c in 477ms, sequenceid=23, compaction requested=true 2023-10-31 05:54:56,539 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:54:56,539 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:56,540 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:54:56,540 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7e09392ae4cf8022f3e80e0b0d3a1885 in 478ms, sequenceid=23, compaction requested=true 2023-10-31 05:54:56,540 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:54:56,540 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:56,540 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:54:56,540 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:54:56,540 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,540 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-31 05:54:56,540 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-31 05:54:56,541 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:56,541 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:56,542 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:56,542 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:54:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:56,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-31 05:54:56,543 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-31 05:54:56,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@181bbfe3[Count = 0] remaining members to acquire global barrier 2023-10-31 05:54:56,543 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:56,546 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:56,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:56,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:56,546 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-31 05:54:56,546 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-31 05:54:56,546 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:54:56,546 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,546 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:54:56,547 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,547 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-31 05:54:56,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:56,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:56,547 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:56,547 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-31 05:54:56,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:56,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:56,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:56,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:56,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:56,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:54:56,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-31 05:54:56,549 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-31 05:54:56,549 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:54:56,550 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:54:56,550 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-31 05:54:56,550 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:54:56,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:56,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:56,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:56,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:56,551 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:54:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:56,552 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:54:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-31 05:54:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,554 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,554 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:56,554 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:54:56,554 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-31 05:54:56,554 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:54:56,554 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:54:56,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:54:56,554 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:54:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:54:56,554 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:56,554 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-31 05:54:56,554 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-31 05:54:56,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-31 05:54:56,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:54:56,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-31 05:54:56,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:54:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:54:56,555 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-31 05:54:56,555 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:54:56,655 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:54:56,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:54:56,656 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:56,656 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): 8d6401043828af0dc71fdb666c576f99/family1 is initiating major compaction (all files) 2023-10-31 05:54:56,656 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:56,657 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:56,657 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of 8d6401043828af0dc71fdb666c576f99/family1 in ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:56,657 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/f0b497bc27684db69e017a0b00501243, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/b40ba55bdea1465ba9c94323692fc87c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/bcec8f6cfc61418db1fc72f613aece96, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/fb4ea8be0dd94f86af3b0654248bd2d0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/95b6badb0d7743d6b800b93d7268366e] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp, totalSize=26.6 K 2023-10-31 05:54:56,657 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting f0b497bc27684db69e017a0b00501243, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731689330 2023-10-31 05:54:56,658 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting b40ba55bdea1465ba9c94323692fc87c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731691188 2023-10-31 05:54:56,658 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting bcec8f6cfc61418db1fc72f613aece96, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731692692 2023-10-31 05:54:56,659 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting fb4ea8be0dd94f86af3b0654248bd2d0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731694125 2023-10-31 05:54:56,659 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 95b6badb0d7743d6b800b93d7268366e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:54:56,671 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): 8d6401043828af0dc71fdb666c576f99#family1#compaction#149 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:57,080 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231031c57939b23a0c44d3869e1c8ab9bb7d3d_del 2023-10-31 05:54:57,080 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031c57939b23a0c44d3869e1c8ab9bb7d3d_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231031c57939b23a0c44d3869e1c8ab9bb7d3d_del 2023-10-31 05:54:57,496 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 560553e97cb94b7dad1941c37a707989 2023-10-31 05:54:57,499 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family1/560553e97cb94b7dad1941c37a707989 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/560553e97cb94b7dad1941c37a707989 2023-10-31 05:54:57,503 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 560553e97cb94b7dad1941c37a707989 2023-10-31 05:54:57,504 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8d6401043828af0dc71fdb666c576f99/family1 of 8d6401043828af0dc71fdb666c576f99 into 560553e97cb94b7dad1941c37a707989(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:54:57,504 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:54:57,504 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:57,505 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): 8d6401043828af0dc71fdb666c576f99/family2 is initiating major compaction (all files) 2023-10-31 05:54:57,505 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:57,505 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:57,505 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of 8d6401043828af0dc71fdb666c576f99/family2 in ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:54:57,506 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/95e846c0b0bf40b0936c9f119f19e91f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/4150a6f356184351a32e6c1ee0112081, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/b347f48796374b85a99f2fe467143479, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/14d843be7df5453d9a195a9147234799, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/1b1c01b490fa434081c9568292ad9a90] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp, totalSize=25.3 K 2023-10-31 05:54:57,506 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 95e846c0b0bf40b0936c9f119f19e91f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731689330 2023-10-31 05:54:57,507 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 4150a6f356184351a32e6c1ee0112081, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731691188 2023-10-31 05:54:57,507 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting b347f48796374b85a99f2fe467143479, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731692692 2023-10-31 05:54:57,508 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 14d843be7df5453d9a195a9147234799, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731694125 2023-10-31 05:54:57,508 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 1b1c01b490fa434081c9568292ad9a90, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:54:57,519 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): 8d6401043828af0dc71fdb666c576f99#family2#compaction#150 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:57,531 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231031731dd70366454345b637e5adaf9f8a98_del 2023-10-31 05:54:57,531 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031731dd70366454345b637e5adaf9f8a98_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231031731dd70366454345b637e5adaf9f8a98_del 2023-10-31 05:54:57,557 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63b0c87cb41c41da8fc7b42ee4cf181a 2023-10-31 05:54:57,558 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/.tmp/family2/63b0c87cb41c41da8fc7b42ee4cf181a as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/63b0c87cb41c41da8fc7b42ee4cf181a 2023-10-31 05:54:57,561 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63b0c87cb41c41da8fc7b42ee4cf181a 2023-10-31 05:54:57,562 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8d6401043828af0dc71fdb666c576f99/family2 of 8d6401043828af0dc71fdb666c576f99 into 63b0c87cb41c41da8fc7b42ee4cf181a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:54:57,562 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:54:57,563 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:57,563 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): 87e435865246ef33e92819389f9c177c/family1 is initiating major compaction (all files) 2023-10-31 05:54:57,563 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:57,563 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:57,564 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of 87e435865246ef33e92819389f9c177c/family1 in ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:57,564 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/67269c6c01af4278a3a30b5e1260bab5, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/b184f2b4340943d694ab04c1392e72d6, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/cd6777b0c6664b66904a9068d9c311d3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/18cce8af738c4317ab2bcaf7c5f450ec, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/d0b1d9d4db324b509a3b9414d007d642] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp, totalSize=26.6 K 2023-10-31 05:54:57,564 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 67269c6c01af4278a3a30b5e1260bab5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731689330 2023-10-31 05:54:57,565 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting b184f2b4340943d694ab04c1392e72d6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731691189 2023-10-31 05:54:57,565 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting cd6777b0c6664b66904a9068d9c311d3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731692692 2023-10-31 05:54:57,565 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 18cce8af738c4317ab2bcaf7c5f450ec, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731694125 2023-10-31 05:54:57,565 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting d0b1d9d4db324b509a3b9414d007d642, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:54:57,583 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): 87e435865246ef33e92819389f9c177c#family1#compaction#151 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:57,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/f0b497bc27684db69e017a0b00501243, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/b40ba55bdea1465ba9c94323692fc87c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/bcec8f6cfc61418db1fc72f613aece96, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/fb4ea8be0dd94f86af3b0654248bd2d0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/95b6badb0d7743d6b800b93d7268366e] to archive 2023-10-31 05:54:57,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:57,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/f0b497bc27684db69e017a0b00501243 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/f0b497bc27684db69e017a0b00501243 2023-10-31 05:54:57,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/b40ba55bdea1465ba9c94323692fc87c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/b40ba55bdea1465ba9c94323692fc87c 2023-10-31 05:54:57,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/bcec8f6cfc61418db1fc72f613aece96 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/bcec8f6cfc61418db1fc72f613aece96 2023-10-31 05:54:57,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/fb4ea8be0dd94f86af3b0654248bd2d0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/fb4ea8be0dd94f86af3b0654248bd2d0 2023-10-31 05:54:57,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/95b6badb0d7743d6b800b93d7268366e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/95b6badb0d7743d6b800b93d7268366e 2023-10-31 05:54:57,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/95e846c0b0bf40b0936c9f119f19e91f, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/4150a6f356184351a32e6c1ee0112081, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/b347f48796374b85a99f2fe467143479, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/14d843be7df5453d9a195a9147234799, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/1b1c01b490fa434081c9568292ad9a90] to archive 2023-10-31 05:54:57,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:57,616 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/95e846c0b0bf40b0936c9f119f19e91f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/95e846c0b0bf40b0936c9f119f19e91f 2023-10-31 05:54:57,617 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/4150a6f356184351a32e6c1ee0112081 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/4150a6f356184351a32e6c1ee0112081 2023-10-31 05:54:57,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/b347f48796374b85a99f2fe467143479 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/b347f48796374b85a99f2fe467143479 2023-10-31 05:54:57,619 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/14d843be7df5453d9a195a9147234799 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/14d843be7df5453d9a195a9147234799 2023-10-31 05:54:57,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/1b1c01b490fa434081c9568292ad9a90 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family2/1b1c01b490fa434081c9568292ad9a90 2023-10-31 05:54:57,991 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231031550c5b1418cd4703aed27edeecbcd240_del 2023-10-31 05:54:57,991 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031550c5b1418cd4703aed27edeecbcd240_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231031550c5b1418cd4703aed27edeecbcd240_del 2023-10-31 05:54:58,409 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 888434a714dd4a13a4d7653b428249b2 2023-10-31 05:54:58,410 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family1/888434a714dd4a13a4d7653b428249b2 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/888434a714dd4a13a4d7653b428249b2 2023-10-31 05:54:58,413 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 888434a714dd4a13a4d7653b428249b2 2023-10-31 05:54:58,414 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 87e435865246ef33e92819389f9c177c/family1 of 87e435865246ef33e92819389f9c177c into 888434a714dd4a13a4d7653b428249b2(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:54:58,414 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:54:58,414 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:58,415 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): 87e435865246ef33e92819389f9c177c/family2 is initiating major compaction (all files) 2023-10-31 05:54:58,415 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:58,415 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:58,415 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of 87e435865246ef33e92819389f9c177c/family2 in ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:54:58,415 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a61d8264223b4ce1bf7335257ecf4d91, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/4d0a5075c40e40c5bb245e73553156fa, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/9e25d66d26e046dba3d54b0f3b5bf5b8, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a1e9be5bbbfc4503b5ebb09bcfe53a17, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/1fd3b994bf134c01814e9cc722dc9914] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp, totalSize=25.3 K 2023-10-31 05:54:58,416 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting a61d8264223b4ce1bf7335257ecf4d91, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731689330 2023-10-31 05:54:58,417 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 4d0a5075c40e40c5bb245e73553156fa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731691189 2023-10-31 05:54:58,417 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 9e25d66d26e046dba3d54b0f3b5bf5b8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731692692 2023-10-31 05:54:58,417 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting a1e9be5bbbfc4503b5ebb09bcfe53a17, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731694125 2023-10-31 05:54:58,418 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 1fd3b994bf134c01814e9cc722dc9914, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:54:58,441 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): 87e435865246ef33e92819389f9c177c#family2#compaction#152 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:54:58,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/67269c6c01af4278a3a30b5e1260bab5, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/b184f2b4340943d694ab04c1392e72d6, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/cd6777b0c6664b66904a9068d9c311d3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/18cce8af738c4317ab2bcaf7c5f450ec, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/d0b1d9d4db324b509a3b9414d007d642] to archive 2023-10-31 05:54:58,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:58,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/67269c6c01af4278a3a30b5e1260bab5 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/67269c6c01af4278a3a30b5e1260bab5 2023-10-31 05:54:58,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/b184f2b4340943d694ab04c1392e72d6 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/b184f2b4340943d694ab04c1392e72d6 2023-10-31 05:54:58,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/cd6777b0c6664b66904a9068d9c311d3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/cd6777b0c6664b66904a9068d9c311d3 2023-10-31 05:54:58,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/18cce8af738c4317ab2bcaf7c5f450ec to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/18cce8af738c4317ab2bcaf7c5f450ec 2023-10-31 05:54:58,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/d0b1d9d4db324b509a3b9414d007d642 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/d0b1d9d4db324b509a3b9414d007d642 2023-10-31 05:54:58,859 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231031472eb338237f48e99365c17dd398c8a4_del 2023-10-31 05:54:58,859 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031472eb338237f48e99365c17dd398c8a4_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231031472eb338237f48e99365c17dd398c8a4_del 2023-10-31 05:54:59,686 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fbbd7772e214c35a497c84001b1f954 2023-10-31 05:54:59,687 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/.tmp/family2/6fbbd7772e214c35a497c84001b1f954 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/6fbbd7772e214c35a497c84001b1f954 2023-10-31 05:54:59,694 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fbbd7772e214c35a497c84001b1f954 2023-10-31 05:54:59,696 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 87e435865246ef33e92819389f9c177c/family2 of 87e435865246ef33e92819389f9c177c into 6fbbd7772e214c35a497c84001b1f954(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:54:59,696 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:54:59,697 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:54:59,697 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): 7e09392ae4cf8022f3e80e0b0d3a1885/family1 is initiating major compaction (all files) 2023-10-31 05:54:59,697 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:54:59,697 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:54:59,698 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of 7e09392ae4cf8022f3e80e0b0d3a1885/family1 in ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:54:59,699 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/672344315d0e4f8db8cf6a4d3ac5ac1a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/c94f3f247e814f8fb50f20d604d33436, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/20d1d5c8a1f8478ba685edf1d015b4c5, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/22838d38547b403ca3d3023dad30a7a6, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/2476eb1d300f4d42aae286e045549124] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp, totalSize=26.6 K 2023-10-31 05:54:59,699 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 672344315d0e4f8db8cf6a4d3ac5ac1a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731689329 2023-10-31 05:54:59,700 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting c94f3f247e814f8fb50f20d604d33436, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731691188 2023-10-31 05:54:59,700 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 20d1d5c8a1f8478ba685edf1d015b4c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731692691 2023-10-31 05:54:59,700 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 22838d38547b403ca3d3023dad30a7a6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731694125 2023-10-31 05:54:59,701 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 2476eb1d300f4d42aae286e045549124, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:54:59,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a61d8264223b4ce1bf7335257ecf4d91, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/4d0a5075c40e40c5bb245e73553156fa, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/9e25d66d26e046dba3d54b0f3b5bf5b8, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a1e9be5bbbfc4503b5ebb09bcfe53a17, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/1fd3b994bf134c01814e9cc722dc9914] to archive 2023-10-31 05:54:59,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:54:59,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a61d8264223b4ce1bf7335257ecf4d91 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a61d8264223b4ce1bf7335257ecf4d91 2023-10-31 05:54:59,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/4d0a5075c40e40c5bb245e73553156fa to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/4d0a5075c40e40c5bb245e73553156fa 2023-10-31 05:54:59,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/9e25d66d26e046dba3d54b0f3b5bf5b8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/9e25d66d26e046dba3d54b0f3b5bf5b8 2023-10-31 05:54:59,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a1e9be5bbbfc4503b5ebb09bcfe53a17 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/a1e9be5bbbfc4503b5ebb09bcfe53a17 2023-10-31 05:54:59,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/1fd3b994bf134c01814e9cc722dc9914 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family2/1fd3b994bf134c01814e9cc722dc9914 2023-10-31 05:54:59,720 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): 7e09392ae4cf8022f3e80e0b0d3a1885#family1#compaction#153 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:55:00,135 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231031c31310f77c314ca3a71f3783ae1bde99_del 2023-10-31 05:55:00,135 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031c31310f77c314ca3a71f3783ae1bde99_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231031c31310f77c314ca3a71f3783ae1bde99_del 2023-10-31 05:55:00,963 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2636daac038340ee91568dcd12537f48 2023-10-31 05:55:00,965 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family1/2636daac038340ee91568dcd12537f48 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/2636daac038340ee91568dcd12537f48 2023-10-31 05:55:00,973 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2636daac038340ee91568dcd12537f48 2023-10-31 05:55:00,974 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7e09392ae4cf8022f3e80e0b0d3a1885/family1 of 7e09392ae4cf8022f3e80e0b0d3a1885 into 2636daac038340ee91568dcd12537f48(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:55:00,974 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:55:00,974 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:55:00,975 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): 7e09392ae4cf8022f3e80e0b0d3a1885/family2 is initiating major compaction (all files) 2023-10-31 05:55:00,975 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:55:00,975 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:55:00,975 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of 7e09392ae4cf8022f3e80e0b0d3a1885/family2 in ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:55:00,975 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/ef5b9f2b1177432286435868e16612d4, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/57307403f2004241bb27abd4cc9097e4, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/8d8bb16509924bb1a0baecf1685825d7, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/88ce15e79bf949ed99d1f392f11eddf9, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/6f1ce891de6b41108cc672cecb741c3f] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp, totalSize=25.3 K 2023-10-31 05:55:00,976 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting ef5b9f2b1177432286435868e16612d4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731689329 2023-10-31 05:55:00,976 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 57307403f2004241bb27abd4cc9097e4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731691188 2023-10-31 05:55:00,977 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 8d8bb16509924bb1a0baecf1685825d7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731692691 2023-10-31 05:55:00,978 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 88ce15e79bf949ed99d1f392f11eddf9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731694125 2023-10-31 05:55:00,978 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 6f1ce891de6b41108cc672cecb741c3f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:55:00,992 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): 7e09392ae4cf8022f3e80e0b0d3a1885#family2#compaction#154 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:55:01,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/672344315d0e4f8db8cf6a4d3ac5ac1a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/c94f3f247e814f8fb50f20d604d33436, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/20d1d5c8a1f8478ba685edf1d015b4c5, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/22838d38547b403ca3d3023dad30a7a6, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/2476eb1d300f4d42aae286e045549124] to archive 2023-10-31 05:55:01,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:01,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/672344315d0e4f8db8cf6a4d3ac5ac1a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/672344315d0e4f8db8cf6a4d3ac5ac1a 2023-10-31 05:55:01,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/c94f3f247e814f8fb50f20d604d33436 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/c94f3f247e814f8fb50f20d604d33436 2023-10-31 05:55:01,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/20d1d5c8a1f8478ba685edf1d015b4c5 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/20d1d5c8a1f8478ba685edf1d015b4c5 2023-10-31 05:55:01,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/22838d38547b403ca3d3023dad30a7a6 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/22838d38547b403ca3d3023dad30a7a6 2023-10-31 05:55:01,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/2476eb1d300f4d42aae286e045549124 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/2476eb1d300f4d42aae286e045549124 2023-10-31 05:55:01,409 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231031728a8b8b549846d7bbeaefbf2a8cf2b5_del 2023-10-31 05:55:01,409 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031728a8b8b549846d7bbeaefbf2a8cf2b5_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231031728a8b8b549846d7bbeaefbf2a8cf2b5_del 2023-10-31 05:55:02,239 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 777c59bef23a4e85be86d495672bfa9e 2023-10-31 05:55:02,240 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/.tmp/family2/777c59bef23a4e85be86d495672bfa9e as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/777c59bef23a4e85be86d495672bfa9e 2023-10-31 05:55:02,246 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 777c59bef23a4e85be86d495672bfa9e 2023-10-31 05:55:02,247 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7e09392ae4cf8022f3e80e0b0d3a1885/family2 of 7e09392ae4cf8022f3e80e0b0d3a1885 into 777c59bef23a4e85be86d495672bfa9e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:55:02,247 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:55:02,254 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:55:02,258 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:55:02,261 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:55:02,262 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:55:02,266 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-31 05:55:02,281 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-10-31 05:55:02,284 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231031c31310f77c314ca3a71f3783ae1bde99_del 2023-10-31 05:55:02,287 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231031c57939b23a0c44d3869e1c8ab9bb7d3d_del 2023-10-31 05:55:02,290 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231031550c5b1418cd4703aed27edeecbcd240_del 2023-10-31 05:55:02,290 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-10-31 05:55:02,291 DEBUG [Listener at localhost/40291] zookeeper.ReadOnlyZKClient(139): Connect 0x30342cf3 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:55:02,294 DEBUG [Listener at localhost/40291] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6725ae25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:55:02,296 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231031 for table='ns:testMinorCompaction' and column='family1' 2023-10-31 05:55:02,296 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231031 for table='ns:testMinorCompaction' and column='family1' 2023-10-31 05:55:02,296 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231031 for table='ns:testMinorCompaction' and column='family1' 2023-10-31 05:55:02,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/ef5b9f2b1177432286435868e16612d4, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/57307403f2004241bb27abd4cc9097e4, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/8d8bb16509924bb1a0baecf1685825d7, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/88ce15e79bf949ed99d1f392f11eddf9, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/6f1ce891de6b41108cc672cecb741c3f] to archive 2023-10-31 05:55:02,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:02,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/ef5b9f2b1177432286435868e16612d4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/ef5b9f2b1177432286435868e16612d4 2023-10-31 05:55:02,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/57307403f2004241bb27abd4cc9097e4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/57307403f2004241bb27abd4cc9097e4 2023-10-31 05:55:02,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/8d8bb16509924bb1a0baecf1685825d7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/8d8bb16509924bb1a0baecf1685825d7 2023-10-31 05:55:02,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/88ce15e79bf949ed99d1f392f11eddf9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/88ce15e79bf949ed99d1f392f11eddf9 2023-10-31 05:55:02,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/6f1ce891de6b41108cc672cecb741c3f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family2/6f1ce891de6b41108cc672cecb741c3f 2023-10-31 05:55:03,151 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031cdd3c2e6318c433fa920ecee019e296e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231031cdd3c2e6318c433fa920ecee019e296e 2023-10-31 05:55:03,151 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031cc59ba12a1394df1b00dc8670d4b0918 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231031cc59ba12a1394df1b00dc8670d4b0918 2023-10-31 05:55:03,152 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103182b71a96783a496396202e457c0d5b20 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023103182b71a96783a496396202e457c0d5b20 2023-10-31 05:55:03,152 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231031 table='ns:testMinorCompaction' column='family1' 2023-10-31 05:55:03,152 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231031 table='ns:testMinorCompaction' column='family1' 2023-10-31 05:55:03,152 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231031 table='ns:testMinorCompaction' column='family1' 2023-10-31 05:55:03,165 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:55:03,165 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39db4897 to 127.0.0.1:64652 2023-10-31 05:55:03,166 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:55:03,166 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:55:03,166 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72cb94a3 to 127.0.0.1:64652 2023-10-31 05:55:03,166 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:55:03,175 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:55:03,177 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:55:03,183 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:55:03,186 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:55:03,203 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231031/family1/fc78f0b42ddb428597cce51e902f4552 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-10-31 05:55:03,203 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231031/family1/3b4c0cb20a9e404f9fece923d2653ec3 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-10-31 05:55:03,205 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231031/family1/fc78f0b42ddb428597cce51e902f4552}] 2023-10-31 05:55:03,205 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231031/family1/3b4c0cb20a9e404f9fece923d2653ec3}] 2023-10-31 05:55:03,211 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231031/family1/eacbd9d03c064ecc88e1f4e1e87be59f first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-10-31 05:55:03,213 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231031/family1/3b4c0cb20a9e404f9fece923d2653ec3 for inclusion in 7e09392ae4cf8022f3e80e0b0d3a1885/family1 2023-10-31 05:55:03,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231031/family1/fc78f0b42ddb428597cce51e902f4552 for inclusion in 87e435865246ef33e92819389f9c177c/family1 2023-10-31 05:55:03,213 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231031/family1/eacbd9d03c064ecc88e1f4e1e87be59f}] 2023-10-31 05:55:03,215 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231031/family1/eacbd9d03c064ecc88e1f4e1e87be59f for inclusion in 8d6401043828af0dc71fdb666c576f99/family1 2023-10-31 05:55:03,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-10-31 05:55:03,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-10-31 05:55:03,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last=1 2023-10-31 05:55:03,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-31 05:55:03,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:55:03,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:55:03,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231031/family1/fc78f0b42ddb428597cce51e902f4552 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__9ng47pes2cjmh9a9b880u9g5asdcafq3ljiffdncrnjrps6r09nn4ctcfh979br7/family1/fc78f0b42ddb428597cce51e902f4552 2023-10-31 05:55:03,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-10-31 05:55:03,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-31 05:55:03,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231031/family1/3b4c0cb20a9e404f9fece923d2653ec3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__1rumfvervi9ih6bcclq3dnf29naut385c2bpr60ii26sg587sg68it54iupf233d/family1/3b4c0cb20a9e404f9fece923d2653ec3 2023-10-31 05:55:03,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:55:03,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231031/family1/eacbd9d03c064ecc88e1f4e1e87be59f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__9bigdt0c7g3hp1idd0h7p65ia8ljbt2jsu3n32g6vrdu2a8fqa37fp91v4ip1cuf/family1/eacbd9d03c064ecc88e1f4e1e87be59f 2023-10-31 05:55:03,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__9ng47pes2cjmh9a9b880u9g5asdcafq3ljiffdncrnjrps6r09nn4ctcfh979br7/family1/fc78f0b42ddb428597cce51e902f4552 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/501fd83126a3456c98e0b7b333f544ae_SeqId_28_ 2023-10-31 05:55:03,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__1rumfvervi9ih6bcclq3dnf29naut385c2bpr60ii26sg587sg68it54iupf233d/family1/3b4c0cb20a9e404f9fece923d2653ec3 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/1c2a3cf4ba5e4a9a9a4a6b3bad9fb91a_SeqId_28_ 2023-10-31 05:55:03,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__9ng47pes2cjmh9a9b880u9g5asdcafq3ljiffdncrnjrps6r09nn4ctcfh979br7/family1/fc78f0b42ddb428597cce51e902f4552 into 87e435865246ef33e92819389f9c177c/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/501fd83126a3456c98e0b7b333f544ae_SeqId_28_ - updating store file list. 2023-10-31 05:55:03,220 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__1rumfvervi9ih6bcclq3dnf29naut385c2bpr60ii26sg587sg68it54iupf233d/family1/3b4c0cb20a9e404f9fece923d2653ec3 into 7e09392ae4cf8022f3e80e0b0d3a1885/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/1c2a3cf4ba5e4a9a9a4a6b3bad9fb91a_SeqId_28_ - updating store file list. 2023-10-31 05:55:03,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__9bigdt0c7g3hp1idd0h7p65ia8ljbt2jsu3n32g6vrdu2a8fqa37fp91v4ip1cuf/family1/eacbd9d03c064ecc88e1f4e1e87be59f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/a196639509ed4f1ab74d56f5707322cd_SeqId_28_ 2023-10-31 05:55:03,221 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__9bigdt0c7g3hp1idd0h7p65ia8ljbt2jsu3n32g6vrdu2a8fqa37fp91v4ip1cuf/family1/eacbd9d03c064ecc88e1f4e1e87be59f into 8d6401043828af0dc71fdb666c576f99/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/a196639509ed4f1ab74d56f5707322cd_SeqId_28_ - updating store file list. 2023-10-31 05:55:03,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/501fd83126a3456c98e0b7b333f544ae_SeqId_28_ into 87e435865246ef33e92819389f9c177c/family1 2023-10-31 05:55:03,223 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/1c2a3cf4ba5e4a9a9a4a6b3bad9fb91a_SeqId_28_ into 7e09392ae4cf8022f3e80e0b0d3a1885/family1 2023-10-31 05:55:03,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__9ng47pes2cjmh9a9b880u9g5asdcafq3ljiffdncrnjrps6r09nn4ctcfh979br7/family1/fc78f0b42ddb428597cce51e902f4552 into 87e435865246ef33e92819389f9c177c/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/family1/501fd83126a3456c98e0b7b333f544ae_SeqId_28_) 2023-10-31 05:55:03,223 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__1rumfvervi9ih6bcclq3dnf29naut385c2bpr60ii26sg587sg68it54iupf233d/family1/3b4c0cb20a9e404f9fece923d2653ec3 into 7e09392ae4cf8022f3e80e0b0d3a1885/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/family1/1c2a3cf4ba5e4a9a9a4a6b3bad9fb91a_SeqId_28_) 2023-10-31 05:55:03,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__9ng47pes2cjmh9a9b880u9g5asdcafq3ljiffdncrnjrps6r09nn4ctcfh979br7/family1/fc78f0b42ddb428597cce51e902f4552 2023-10-31 05:55:03,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__1rumfvervi9ih6bcclq3dnf29naut385c2bpr60ii26sg587sg68it54iupf233d/family1/3b4c0cb20a9e404f9fece923d2653ec3 2023-10-31 05:55:03,225 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/a196639509ed4f1ab74d56f5707322cd_SeqId_28_ into 8d6401043828af0dc71fdb666c576f99/family1 2023-10-31 05:55:03,225 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__9bigdt0c7g3hp1idd0h7p65ia8ljbt2jsu3n32g6vrdu2a8fqa37fp91v4ip1cuf/family1/eacbd9d03c064ecc88e1f4e1e87be59f into 8d6401043828af0dc71fdb666c576f99/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/family1/a196639509ed4f1ab74d56f5707322cd_SeqId_28_) 2023-10-31 05:55:03,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__ns_testMinorCompaction__9bigdt0c7g3hp1idd0h7p65ia8ljbt2jsu3n32g6vrdu2a8fqa37fp91v4ip1cuf/family1/eacbd9d03c064ecc88e1f4e1e87be59f 2023-10-31 05:55:03,226 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231031 table='ns:testMinorCompaction' column='family1' 2023-10-31 05:55:03,226 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231031 table='ns:testMinorCompaction' column='family1' 2023-10-31 05:55:03,226 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:03,226 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:03,227 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231031 table='ns:testMinorCompaction' column='family1' 2023-10-31 05:55:03,227 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:03,228 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023103164304eef9ae84bd39ec00cf6630512e6 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023103164304eef9ae84bd39ec00cf6630512e6 2023-10-31 05:55:03,228 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-31 05:55:03,228 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231031' 2023-10-31 05:55:03,228 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310310c4f0ae2fdf8468088ea69780da47260 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310310c4f0ae2fdf8468088ea69780da47260 2023-10-31 05:55:03,228 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-31 05:55:03,228 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231031' 2023-10-31 05:55:03,228 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231031 for table='ns:testMinorCompaction' and column='family1' 2023-10-31 05:55:03,228 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231031 for table='ns:testMinorCompaction' and column='family1' 2023-10-31 05:55:03,228 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231031ad8547b0262949afbfcda86a075b957e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231031ad8547b0262949afbfcda86a075b957e 2023-10-31 05:55:03,228 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-31 05:55:03,228 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231031' 2023-10-31 05:55:03,229 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231031 for table='ns:testMinorCompaction' and column='family1' 2023-10-31 05:55:03,229 INFO [Listener at localhost/40291] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-10-31 05:55:03,231 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:55:03,233 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:55:03,236 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:55:03,237 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:55:03,253 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=256 (was 286), OpenFileDescriptor=640 (was 761), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=123 (was 120) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1184 (was 1248) 2023-10-31 05:55:03,264 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=256, OpenFileDescriptor=640, MaxFileDescriptor=60000, SystemLoadAverage=123, ProcessCount=169, AvailableMemoryMB=1183 2023-10-31 05:55:03,267 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-31 05:55:03,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:03,269 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:55:03,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-10-31 05:55:03,269 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:55:03,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-31 05:55:03,270 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac 2023-10-31 05:55:03,270 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac empty. 2023-10-31 05:55:03,271 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac 2023-10-31 05:55:03,271 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-10-31 05:55:03,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-31 05:55:03,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-31 05:55:03,680 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-31 05:55:03,682 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 809ec7d82e56357140163c2d715145ac, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:55:03,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-31 05:55:04,089 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:55:04,089 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 809ec7d82e56357140163c2d715145ac, disabling compactions & flushes 2023-10-31 05:55:04,089 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:04,089 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:04,089 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. after waiting 0 ms 2023-10-31 05:55:04,089 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:04,089 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:04,089 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:04,093 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:55:04,095 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698731704095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731704095"}]},"ts":"1698731704095"} 2023-10-31 05:55:04,097 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-31 05:55:04,098 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:55:04,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731704099"}]},"ts":"1698731704099"} 2023-10-31 05:55:04,100 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-31 05:55:04,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=809ec7d82e56357140163c2d715145ac, ASSIGN}] 2023-10-31 05:55:04,103 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=809ec7d82e56357140163c2d715145ac, ASSIGN 2023-10-31 05:55:04,103 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=809ec7d82e56357140163c2d715145ac, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:55:04,255 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=809ec7d82e56357140163c2d715145ac, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:04,255 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698731704255"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731704255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731704255"}]},"ts":"1698731704255"} 2023-10-31 05:55:04,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 809ec7d82e56357140163c2d715145ac, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:55:04,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-31 05:55:04,410 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:04,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:04,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 809ec7d82e56357140163c2d715145ac, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac.', STARTKEY => '', ENDKEY => ''} 2023-10-31 05:55:04,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 809ec7d82e56357140163c2d715145ac 2023-10-31 05:55:04,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:55:04,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 809ec7d82e56357140163c2d715145ac 2023-10-31 05:55:04,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 809ec7d82e56357140163c2d715145ac 2023-10-31 05:55:04,424 INFO [StoreOpener-809ec7d82e56357140163c2d715145ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 809ec7d82e56357140163c2d715145ac 2023-10-31 05:55:04,427 DEBUG [StoreOpener-809ec7d82e56357140163c2d715145ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1 2023-10-31 05:55:04,427 DEBUG [StoreOpener-809ec7d82e56357140163c2d715145ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1 2023-10-31 05:55:04,427 INFO [StoreOpener-809ec7d82e56357140163c2d715145ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 809ec7d82e56357140163c2d715145ac columnFamilyName family1 2023-10-31 05:55:04,429 INFO [StoreOpener-809ec7d82e56357140163c2d715145ac-1] regionserver.HStore(310): Store=809ec7d82e56357140163c2d715145ac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:55:04,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac 2023-10-31 05:55:04,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac 2023-10-31 05:55:04,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 809ec7d82e56357140163c2d715145ac 2023-10-31 05:55:04,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:55:04,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 809ec7d82e56357140163c2d715145ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67540709, jitterRate=0.006434991955757141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-31 05:55:04,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:04,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac., pid=114, masterSystemTime=1698731704410 2023-10-31 05:55:04,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:04,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:04,439 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=809ec7d82e56357140163c2d715145ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:04,439 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698731704439"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731704439"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731704439"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731704439"}]},"ts":"1698731704439"} 2023-10-31 05:55:04,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-10-31 05:55:04,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 809ec7d82e56357140163c2d715145ac, server=jenkins-hbase20.apache.org,43723,1698731565849 in 184 msec 2023-10-31 05:55:04,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-10-31 05:55:04,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=809ec7d82e56357140163c2d715145ac, ASSIGN in 341 msec 2023-10-31 05:55:04,445 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:55:04,446 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731704445"}]},"ts":"1698731704445"} 2023-10-31 05:55:04,447 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-31 05:55:04,449 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:55:04,450 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1820 sec 2023-10-31 05:55:05,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-31 05:55:05,379 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-10-31 05:55:05,408 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:05,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:05,409 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:05,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:05,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:55:05,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:55:05,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:05,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:05,411 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:05,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:05,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:05,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:05,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:05,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:05,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:05,413 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:05,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:05,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:55:05,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:05,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:55:05,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:55:05,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:05,413 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:05,413 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. started... 2023-10-31 05:55:05,414 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 809ec7d82e56357140163c2d715145ac 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-31 05:55:05,838 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b3c8d746d2394ed6a042597e698611b4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b3c8d746d2394ed6a042597e698611b4 2023-10-31 05:55:06,044 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:06,246 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/57b62c59bbae461c97b962273787c7b7 2023-10-31 05:55:06,260 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/57b62c59bbae461c97b962273787c7b7 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/57b62c59bbae461c97b962273787c7b7 2023-10-31 05:55:06,265 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/57b62c59bbae461c97b962273787c7b7, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-31 05:55:06,266 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 809ec7d82e56357140163c2d715145ac in 852ms, sequenceid=5, compaction requested=false 2023-10-31 05:55:06,267 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:06,267 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:06,267 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:55:06,267 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:55:06,267 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,267 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:55:06,267 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:55:06,269 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,269 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:06,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:06,270 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,270 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:06,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:06,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:06,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:06,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:55:06,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a1d3c0b[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:06,272 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:55:06,272 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,273 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,273 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:55:06,273 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:55:06,273 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:06,273 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,274 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:06,275 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:55:06,275 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,275 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:06,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:06,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:06,275 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:55:06,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:06,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:06,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:06,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:06,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:55:06,279 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:55:06,280 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:06,280 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:06,280 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,280 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:06,285 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,285 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:06,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,285 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:06,286 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:06,287 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:06,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:06,297 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,297 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:06,297 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:06,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,297 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,397 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:06,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:06,407 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:06,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:06,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,410 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:06,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:06,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:55:06,410 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:55:06,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,413 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:06,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:06,413 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,414 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:06,414 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:06,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,416 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,416 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:55:06,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:06,417 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:55:06,417 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:06,417 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:55:06,417 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:55:06,417 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:06,417 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:06,417 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. started... 2023-10-31 05:55:06,417 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 809ec7d82e56357140163c2d715145ac 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-31 05:55:06,842 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289af5eece41e74ea2ae84a7df927ccd82 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511289af5eece41e74ea2ae84a7df927ccd82 2023-10-31 05:55:07,250 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/9a3967154afa416c97de37a2f0c2922c 2023-10-31 05:55:07,258 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/9a3967154afa416c97de37a2f0c2922c as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/9a3967154afa416c97de37a2f0c2922c 2023-10-31 05:55:07,263 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/9a3967154afa416c97de37a2f0c2922c, entries=1, sequenceid=9, filesize=5.0 K 2023-10-31 05:55:07,264 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 809ec7d82e56357140163c2d715145ac in 847ms, sequenceid=9, compaction requested=false 2023-10-31 05:55:07,264 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:07,264 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:07,264 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:55:07,264 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:55:07,264 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,264 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:55:07,264 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:55:07,315 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,315 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:07,316 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,316 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:07,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:55:07,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fbc700c[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:07,321 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:55:07,322 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,323 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,323 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:55:07,324 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:55:07,324 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,324 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:07,324 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:07,326 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:55:07,326 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,326 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:07,326 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:55:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:07,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:07,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:55:07,331 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:55:07,331 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:07,331 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:07,331 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,331 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:07,332 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,332 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,333 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:07,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:07,333 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:07,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,335 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,338 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,338 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,338 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,338 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,339 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:07,339 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,339 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:07,339 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:07,339 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,339 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:07,339 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:07,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:07,339 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,339 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:07,339 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:07,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:55:07,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:07,440 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:07,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:07,445 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:07,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:07,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,447 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:07,447 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:07,447 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:55:07,447 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:55:07,448 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,448 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,449 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:07,449 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:07,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:07,450 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:07,450 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:07,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,451 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,451 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:55:07,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:07,451 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:55:07,451 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:07,451 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:55:07,452 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:55:07,452 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:07,452 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:07,452 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. started... 2023-10-31 05:55:07,452 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 809ec7d82e56357140163c2d715145ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:55:07,873 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120132536b82299f49af8da2ab90f26a1535 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120132536b82299f49af8da2ab90f26a1535 2023-10-31 05:55:08,282 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/155fc53f5b26460da7077c29dba4e937 2023-10-31 05:55:08,294 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/155fc53f5b26460da7077c29dba4e937 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/155fc53f5b26460da7077c29dba4e937 2023-10-31 05:55:08,298 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/155fc53f5b26460da7077c29dba4e937, entries=1, sequenceid=13, filesize=4.9 K 2023-10-31 05:55:08,299 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 809ec7d82e56357140163c2d715145ac in 847ms, sequenceid=13, compaction requested=true 2023-10-31 05:55:08,299 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:08,299 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:08,299 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:55:08,299 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:55:08,299 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,299 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:55:08,299 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:55:08,301 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,301 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:08,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:08,301 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,301 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:08,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:08,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:55:08,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7afaee50[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:08,303 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:55:08,303 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,304 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,304 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:55:08,304 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:55:08,304 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:08,304 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,304 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:08,305 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:55:08,305 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,305 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:08,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,305 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:55:08,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:08,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:08,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:08,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:08,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:08,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:08,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:55:08,308 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:55:08,309 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:08,309 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:08,309 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,309 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:08,318 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,318 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,319 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:08,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:08,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:08,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:08,320 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:08,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,322 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,327 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,327 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:08,327 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:08,327 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,327 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:08,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:55:08,327 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:08,327 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,327 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:08,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:08,327 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,328 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:08,328 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:08,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:08,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:08,428 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:08,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:08,440 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:08,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:08,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,443 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:08,444 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:08,444 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:55:08,444 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:55:08,445 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,445 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,446 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:08,446 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:08,447 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:08,447 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:08,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,449 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:55:08,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:08,449 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:55:08,450 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:08,450 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:55:08,450 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:55:08,450 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:08,450 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:08,450 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. started... 2023-10-31 05:55:08,450 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 809ec7d82e56357140163c2d715145ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:55:08,876 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205390caa1cec63435c8af8d2d3d5787de9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205390caa1cec63435c8af8d2d3d5787de9 2023-10-31 05:55:09,282 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/2eaa0e5413de48c6b163eea8c0fce51a 2023-10-31 05:55:09,286 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/2eaa0e5413de48c6b163eea8c0fce51a as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/2eaa0e5413de48c6b163eea8c0fce51a 2023-10-31 05:55:09,290 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/2eaa0e5413de48c6b163eea8c0fce51a, entries=1, sequenceid=17, filesize=4.9 K 2023-10-31 05:55:09,291 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 809ec7d82e56357140163c2d715145ac in 841ms, sequenceid=17, compaction requested=true 2023-10-31 05:55:09,291 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:09,291 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:09,292 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:55:09,292 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:55:09,292 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,292 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:55:09,292 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:55:09,293 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,293 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:09,293 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,293 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:09,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:55:09,295 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:55:09,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@452c4740[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:09,295 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,295 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,296 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:55:09,296 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:55:09,296 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:09,296 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,296 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:09,297 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,297 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:55:09,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:09,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:09,297 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:09,297 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:55:09,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:09,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:09,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:09,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:09,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:55:09,299 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:55:09,299 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:09,299 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:09,299 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,299 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:09,300 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,300 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,300 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:09,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:09,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:09,301 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:09,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:09,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:09,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:09,302 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:09,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,304 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,304 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:09,304 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:09,304 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,304 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,304 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:09,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:09,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:09,304 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:09,304 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:09,304 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,305 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,305 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,305 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:09,305 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:09,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:55:09,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:09,305 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:09,405 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:09,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:09,409 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:09,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:09,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,411 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:09,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:09,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:55:09,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:55:09,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,411 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,412 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:09,412 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:09,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:09,412 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:09,412 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:09,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:09,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,413 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,413 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:55:09,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:09,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:55:09,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:09,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:55:09,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:55:09,413 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:09,413 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:09,413 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. started... 2023-10-31 05:55:09,413 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 809ec7d82e56357140163c2d715145ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:55:09,826 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ea647a168ba74262aea62a1ea2f75ada to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ea647a168ba74262aea62a1ea2f75ada 2023-10-31 05:55:09,952 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:55:10,235 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/169ca68f96944969a4009d3ff6404b77 2023-10-31 05:55:10,239 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/169ca68f96944969a4009d3ff6404b77 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/169ca68f96944969a4009d3ff6404b77 2023-10-31 05:55:10,242 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/169ca68f96944969a4009d3ff6404b77, entries=1, sequenceid=21, filesize=4.9 K 2023-10-31 05:55:10,243 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 809ec7d82e56357140163c2d715145ac in 830ms, sequenceid=21, compaction requested=true 2023-10-31 05:55:10,243 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:10,243 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:10,243 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:55:10,243 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:55:10,243 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,243 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:55:10,243 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:55:10,244 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,244 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:10,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:10,245 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,245 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:10,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:10,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:10,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:10,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:55:10,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5642d68a[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:10,246 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:55:10,246 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,246 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,246 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:55:10,246 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:55:10,246 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:10,246 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,246 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:10,247 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:55:10,247 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,247 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:10,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:10,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:10,247 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:55:10,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:10,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:10,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:10,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:10,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:55:10,249 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:55:10,249 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:10,249 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:10,249 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,249 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:10,251 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,251 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,251 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:10,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:10,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:10,252 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:10,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:10,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:10,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:10,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,252 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:10,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:10,254 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:10,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:55:10,254 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:10,254 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:10,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:10,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:10,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:10,254 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:10,354 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:10,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:10,359 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:10,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:10,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,361 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:10,361 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:10,361 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:55:10,361 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:55:10,361 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,361 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,362 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,362 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:10,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:10,362 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:10,362 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,363 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,363 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:55:10,363 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:10,363 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:55:10,363 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:10,363 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:55:10,363 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:55:10,363 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:10,363 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:10,363 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. started... 2023-10-31 05:55:10,363 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 809ec7d82e56357140163c2d715145ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:55:10,779 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314df052290c524520aaf14290d18d400b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314df052290c524520aaf14290d18d400b 2023-10-31 05:55:11,183 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/b5c5e16b51e246abb138ac355b8462e8 2023-10-31 05:55:11,187 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/b5c5e16b51e246abb138ac355b8462e8 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/b5c5e16b51e246abb138ac355b8462e8 2023-10-31 05:55:11,191 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/b5c5e16b51e246abb138ac355b8462e8, entries=1, sequenceid=25, filesize=4.9 K 2023-10-31 05:55:11,192 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 809ec7d82e56357140163c2d715145ac in 829ms, sequenceid=25, compaction requested=true 2023-10-31 05:55:11,192 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:11,192 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:11,192 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:55:11,192 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:55:11,192 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,192 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:55:11,192 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:55:11,193 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,193 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:11,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:11,194 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,194 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:11,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:11,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:11,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:11,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:55:11,195 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:55:11,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aa2e05e[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:11,195 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,196 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,196 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:55:11,196 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:55:11,196 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,196 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:11,196 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:11,197 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:55:11,197 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,197 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:11,197 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:55:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:11,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:55:11,199 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:55:11,199 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:11,199 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:11,199 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,199 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:11,199 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,199 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:11,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,199 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:11,200 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,201 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,202 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,202 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:11,202 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:11,202 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:11,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:11,202 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:11,202 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:11,202 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:11,202 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:11,202 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:11,202 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,203 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:11,203 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:11,303 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:11,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:11,307 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:11,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:11,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,308 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:11,308 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:11,308 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:55:11,308 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:55:11,309 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,309 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,309 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,309 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:11,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:11,310 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:11,310 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,310 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,311 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:55:11,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:11,311 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:55:11,311 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:11,311 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:55:11,311 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:55:11,311 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:11,311 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:11,311 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. started... 2023-10-31 05:55:11,311 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 809ec7d82e56357140163c2d715145ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:55:11,728 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013d28ab1144bf4a6abdfecb7a57da8da1 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013d28ab1144bf4a6abdfecb7a57da8da1 2023-10-31 05:55:12,136 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/8e6b536e93a44edcaeda844a2d5a4d96 2023-10-31 05:55:12,147 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/8e6b536e93a44edcaeda844a2d5a4d96 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/8e6b536e93a44edcaeda844a2d5a4d96 2023-10-31 05:55:12,153 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/8e6b536e93a44edcaeda844a2d5a4d96, entries=1, sequenceid=29, filesize=4.9 K 2023-10-31 05:55:12,154 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 809ec7d82e56357140163c2d715145ac in 843ms, sequenceid=29, compaction requested=true 2023-10-31 05:55:12,154 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:12,154 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:12,154 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:55:12,155 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:55:12,155 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,155 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:55:12,155 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:55:12,156 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,156 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:12,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:12,156 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,156 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:12,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:12,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:12,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:12,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:55:12,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27070734[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:12,159 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:55:12,159 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,159 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,160 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:55:12,160 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:55:12,160 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:12,160 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,160 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:12,161 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:55:12,161 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,161 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:12,161 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:55:12,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:12,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:12,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:12,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:12,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:12,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:12,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:55:12,164 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:55:12,164 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:12,164 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:12,164 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,164 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:12,165 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,165 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:12,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:12,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,165 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:12,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:12,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:12,165 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:12,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:12,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,166 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:12,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,168 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,168 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:12,168 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:12,168 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:12,168 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:12,168 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:12,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:12,168 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:12,168 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,168 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,168 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:12,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:12,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:12,168 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,169 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:12,169 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,169 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,269 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:12,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:12,278 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:12,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:12,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,280 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:12,280 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:12,280 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:55:12,280 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:55:12,281 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,281 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,282 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:12,282 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:12,282 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:12,282 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:12,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,284 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,284 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:55:12,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:12,284 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:55:12,284 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:12,284 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:55:12,284 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:55:12,284 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:12,284 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:12,284 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. started... 2023-10-31 05:55:12,285 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 809ec7d82e56357140163c2d715145ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:55:12,706 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103aa88f81e8e8a4f9288f8c88d1dfb0de2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103aa88f81e8e8a4f9288f8c88d1dfb0de2 2023-10-31 05:55:13,112 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/1f41ae7c56da4ad7be97ca982de77220 2023-10-31 05:55:13,124 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/1f41ae7c56da4ad7be97ca982de77220 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/1f41ae7c56da4ad7be97ca982de77220 2023-10-31 05:55:13,131 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/1f41ae7c56da4ad7be97ca982de77220, entries=1, sequenceid=33, filesize=4.9 K 2023-10-31 05:55:13,132 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 809ec7d82e56357140163c2d715145ac in 847ms, sequenceid=33, compaction requested=true 2023-10-31 05:55:13,132 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:13,132 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:13,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:55:13,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:55:13,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:55:13,132 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:55:13,134 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,134 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:13,135 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,135 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:13,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:13,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:13,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:13,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:55:13,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3652d3[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:13,137 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:55:13,137 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,138 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,138 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:55:13,138 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:55:13,138 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:13,138 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,138 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:13,140 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,140 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:55:13,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:13,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:13,140 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:13,141 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:55:13,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:13,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:13,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:13,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:13,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:55:13,144 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:55:13,144 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:13,144 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:13,144 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,144 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:13,158 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,158 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,158 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:13,159 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,162 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:13,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,174 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,174 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:13,174 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,174 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:13,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:55:13,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:13,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:13,174 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:13,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:13,175 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:13,174 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,175 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,176 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,176 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,176 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:13,176 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:13,176 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:13,276 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:13,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:13,288 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:13,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:13,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,291 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:13,291 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:13,291 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:55:13,291 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:55:13,291 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,291 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,292 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,292 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:13,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:13,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:13,292 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:13,292 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:13,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:13,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,293 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,293 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:55:13,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:13,293 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:55:13,293 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:13,293 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:55:13,293 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:55:13,293 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:13,293 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:13,293 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. started... 2023-10-31 05:55:13,293 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 809ec7d82e56357140163c2d715145ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:55:13,714 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074973083bb2bc4cc28751f3fdee538811 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509074973083bb2bc4cc28751f3fdee538811 2023-10-31 05:55:14,123 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/876d2831943549049a6f5ec774480268 2023-10-31 05:55:14,133 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/876d2831943549049a6f5ec774480268 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/876d2831943549049a6f5ec774480268 2023-10-31 05:55:14,137 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/876d2831943549049a6f5ec774480268, entries=1, sequenceid=37, filesize=4.9 K 2023-10-31 05:55:14,138 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 809ec7d82e56357140163c2d715145ac in 845ms, sequenceid=37, compaction requested=true 2023-10-31 05:55:14,138 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:14,138 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:14,138 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:55:14,138 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:55:14,139 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,139 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:55:14,139 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:55:14,140 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,140 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:14,140 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,141 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:14,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:55:14,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@400022d9[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:14,143 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:55:14,143 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,143 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,144 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:55:14,144 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:55:14,144 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:14,144 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,144 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:14,145 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:55:14,145 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,145 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:14,145 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:55:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:14,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:14,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:14,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:55:14,149 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:55:14,149 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:14,149 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:14,149 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,149 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:14,151 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,151 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:14,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,151 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:14,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:14,152 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,154 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:14,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,156 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,156 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:14,156 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,157 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,157 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,157 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,157 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,157 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:14,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:14,156 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:14,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-31 05:55:14,157 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:14,157 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:14,157 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:14,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:14,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:14,158 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:14,158 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:14,258 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:14,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:14,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:14,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:14,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,272 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:14,272 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:14,272 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-31 05:55:14,272 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-31 05:55:14,272 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,273 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,274 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:14,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:14,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:14,274 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,275 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:14,275 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:14,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:14,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,276 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,276 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-31 05:55:14,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:14,276 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-31 05:55:14,276 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:14,276 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-31 05:55:14,277 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-31 05:55:14,277 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:14,277 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:14,277 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. started... 2023-10-31 05:55:14,277 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 809ec7d82e56357140163c2d715145ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-31 05:55:14,700 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ee9edbf3a84e4fe38dc70563a1650fd1 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120ee9edbf3a84e4fe38dc70563a1650fd1 2023-10-31 05:55:15,107 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/818c1a59c9bf4ff9a7ce8a4330952596 2023-10-31 05:55:15,120 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/818c1a59c9bf4ff9a7ce8a4330952596 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/818c1a59c9bf4ff9a7ce8a4330952596 2023-10-31 05:55:15,126 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/818c1a59c9bf4ff9a7ce8a4330952596, entries=1, sequenceid=41, filesize=4.9 K 2023-10-31 05:55:15,127 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 809ec7d82e56357140163c2d715145ac in 850ms, sequenceid=41, compaction requested=true 2023-10-31 05:55:15,127 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:15,127 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:15,127 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-31 05:55:15,127 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-31 05:55:15,127 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,127 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-31 05:55:15,127 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-31 05:55:15,128 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,129 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:15,129 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,129 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:15,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-31 05:55:15,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dbd8a97[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:15,132 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-31 05:55:15,132 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,133 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,133 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-31 05:55:15,133 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-31 05:55:15,133 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:15,133 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,133 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:15,134 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-31 05:55:15,134 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,134 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:15,134 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-31 05:55:15,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:15,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:15,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:15,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:15,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-31 05:55:15,138 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-31 05:55:15,138 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:15,138 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:15,138 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,138 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:15,141 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,142 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,142 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:15,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:15,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:15,142 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:15,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,144 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,150 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,150 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,150 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:15,150 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:15,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:15,150 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:15,150 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-31 05:55:15,151 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:15,150 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:15,150 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:15,151 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,151 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,151 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:15,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:15,151 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:15,151 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:15,252 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:15,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:15,257 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-10-31 05:55:15,260 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:55:15,261 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:55:15,262 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732315262 2023-10-31 05:55:15,262 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:55:15,265 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-31 05:55:15,267 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-31 05:55:15,267 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:55:15,269 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x2f839d17 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:55:15,274 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dcedc5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:55:15,274 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:55:16,107 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c4d452bbe6bd4c5896eea6943fd2391f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103c4d452bbe6bd4c5896eea6943fd2391f 2023-10-31 05:55:16,108 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:55:16,121 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:55:16,123 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:55:16,130 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:55:16,131 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:55:16,138 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b0485ee895974670b4989f7b8fdcfca0 first=Optional[r5] last=Optional[r6] 2023-10-31 05:55:16,139 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b0485ee895974670b4989f7b8fdcfca0}] 2023-10-31 05:55:16,144 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b0485ee895974670b4989f7b8fdcfca0 for inclusion in 809ec7d82e56357140163c2d715145ac/family1 2023-10-31 05:55:16,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-31 05:55:16,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:55:16,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:16,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b0485ee895974670b4989f7b8fdcfca0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hqm6gchm03e1t3n0gvt7ufqf9vsfb1g2fdkhvd4lcn5ttci9evbecmclb0b2cgc4/family1/b0485ee895974670b4989f7b8fdcfca0 2023-10-31 05:55:16,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hqm6gchm03e1t3n0gvt7ufqf9vsfb1g2fdkhvd4lcn5ttci9evbecmclb0b2cgc4/family1/b0485ee895974670b4989f7b8fdcfca0 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/577362da24a0451fb0efac2372930329_SeqId_44_ 2023-10-31 05:55:16,150 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hqm6gchm03e1t3n0gvt7ufqf9vsfb1g2fdkhvd4lcn5ttci9evbecmclb0b2cgc4/family1/b0485ee895974670b4989f7b8fdcfca0 into 809ec7d82e56357140163c2d715145ac/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/577362da24a0451fb0efac2372930329_SeqId_44_ - updating store file list. 2023-10-31 05:55:16,153 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/577362da24a0451fb0efac2372930329_SeqId_44_ into 809ec7d82e56357140163c2d715145ac/family1 2023-10-31 05:55:16,153 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hqm6gchm03e1t3n0gvt7ufqf9vsfb1g2fdkhvd4lcn5ttci9evbecmclb0b2cgc4/family1/b0485ee895974670b4989f7b8fdcfca0 into 809ec7d82e56357140163c2d715145ac/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/577362da24a0451fb0efac2372930329_SeqId_44_) 2023-10-31 05:55:16,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hqm6gchm03e1t3n0gvt7ufqf9vsfb1g2fdkhvd4lcn5ttci9evbecmclb0b2cgc4/family1/b0485ee895974670b4989f7b8fdcfca0 2023-10-31 05:55:16,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-31 05:55:16,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-31 05:55:16,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(1912): 809ec7d82e56357140163c2d715145ac/family1 is initiating minor compaction 2023-10-31 05:55:16,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1d315df2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:55:16,156 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 809ec7d82e56357140163c2d715145ac/family1 in testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:16,156 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/9a3967154afa416c97de37a2f0c2922c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/155fc53f5b26460da7077c29dba4e937, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/2eaa0e5413de48c6b163eea8c0fce51a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/169ca68f96944969a4009d3ff6404b77, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/b5c5e16b51e246abb138ac355b8462e8, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/8e6b536e93a44edcaeda844a2d5a4d96, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/1f41ae7c56da4ad7be97ca982de77220, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/876d2831943549049a6f5ec774480268, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/818c1a59c9bf4ff9a7ce8a4330952596, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/577362da24a0451fb0efac2372930329_SeqId_44_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp, totalSize=49.7 K 2023-10-31 05:55:16,156 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 9a3967154afa416c97de37a2f0c2922c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-31 05:55:16,156 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 155fc53f5b26460da7077c29dba4e937, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-31 05:55:16,156 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 2eaa0e5413de48c6b163eea8c0fce51a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-31 05:55:16,156 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 169ca68f96944969a4009d3ff6404b77, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-31 05:55:16,156 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting b5c5e16b51e246abb138ac355b8462e8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-31 05:55:16,156 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 8e6b536e93a44edcaeda844a2d5a4d96, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-31 05:55:16,156 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 1f41ae7c56da4ad7be97ca982de77220, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-31 05:55:16,156 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 876d2831943549049a6f5ec774480268, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-31 05:55:16,156 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 818c1a59c9bf4ff9a7ce8a4330952596, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-31 05:55:16,156 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 577362da24a0451fb0efac2372930329_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-31 05:55:16,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:55:16,158 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:16,160 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013d28ab1144bf4a6abdfecb7a57da8da1 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013d28ab1144bf4a6abdfecb7a57da8da1 2023-10-31 05:55:16,162 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103aa88f81e8e8a4f9288f8c88d1dfb0de2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103aa88f81e8e8a4f9288f8c88d1dfb0de2 2023-10-31 05:55:16,162 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-31 05:55:16,162 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-31 05:55:16,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:55:16,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:55:16,192 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): 809ec7d82e56357140163c2d715145ac#family1#compaction#165 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-31 05:55:16,217 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231db28399a59514f45aa3ad87babcdd1cc to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231db28399a59514f45aa3ad87babcdd1cc 2023-10-31 05:55:16,217 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:55:16,235 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ca4f6f6588754f25bf58472a22d6b065 first=Optional[r1] last=Optional[r4] 2023-10-31 05:55:16,236 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ca4f6f6588754f25bf58472a22d6b065}] 2023-10-31 05:55:16,238 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ca4f6f6588754f25bf58472a22d6b065 for inclusion in 809ec7d82e56357140163c2d715145ac/family1 2023-10-31 05:55:16,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-31 05:55:16,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:55:16,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:16,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ca4f6f6588754f25bf58472a22d6b065 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__pn3ggjqb6g0qdqavoqdsacj55uumeqgahekf7matepo7juhh6t58shivnes62d22/family1/ca4f6f6588754f25bf58472a22d6b065 2023-10-31 05:55:16,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__pn3ggjqb6g0qdqavoqdsacj55uumeqgahekf7matepo7juhh6t58shivnes62d22/family1/ca4f6f6588754f25bf58472a22d6b065 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/c22a1000b35a401bab347ee640542852_SeqId_46_ 2023-10-31 05:55:16,243 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__pn3ggjqb6g0qdqavoqdsacj55uumeqgahekf7matepo7juhh6t58shivnes62d22/family1/ca4f6f6588754f25bf58472a22d6b065 into 809ec7d82e56357140163c2d715145ac/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/c22a1000b35a401bab347ee640542852_SeqId_46_ - updating store file list. 2023-10-31 05:55:16,246 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/c22a1000b35a401bab347ee640542852_SeqId_46_ into 809ec7d82e56357140163c2d715145ac/family1 2023-10-31 05:55:16,246 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__pn3ggjqb6g0qdqavoqdsacj55uumeqgahekf7matepo7juhh6t58shivnes62d22/family1/ca4f6f6588754f25bf58472a22d6b065 into 809ec7d82e56357140163c2d715145ac/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/c22a1000b35a401bab347ee640542852_SeqId_46_) 2023-10-31 05:55:16,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__pn3ggjqb6g0qdqavoqdsacj55uumeqgahekf7matepo7juhh6t58shivnes62d22/family1/ca4f6f6588754f25bf58472a22d6b065 2023-10-31 05:55:16,248 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:55:16,249 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:16,251 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120132536b82299f49af8da2ab90f26a1535 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120132536b82299f49af8da2ab90f26a1535 2023-10-31 05:55:16,252 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205390caa1cec63435c8af8d2d3d5787de9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205390caa1cec63435c8af8d2d3d5787de9 2023-10-31 05:55:16,253 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ea647a168ba74262aea62a1ea2f75ada to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228ea647a168ba74262aea62a1ea2f75ada 2023-10-31 05:55:16,254 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314df052290c524520aaf14290d18d400b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314df052290c524520aaf14290d18d400b 2023-10-31 05:55:16,254 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-31 05:55:16,254 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-31 05:55:16,254 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:55:16,254 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:55:16,611 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/3d974fa4b2f1491b90e01da4c37299a3 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/3d974fa4b2f1491b90e01da4c37299a3 2023-10-31 05:55:16,618 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 809ec7d82e56357140163c2d715145ac/family1 of 809ec7d82e56357140163c2d715145ac into 3d974fa4b2f1491b90e01da4c37299a3(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:55:16,618 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:16,619 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698731716156; duration=0sec 2023-10-31 05:55:16,619 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:55:16,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/9a3967154afa416c97de37a2f0c2922c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/155fc53f5b26460da7077c29dba4e937, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/2eaa0e5413de48c6b163eea8c0fce51a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/169ca68f96944969a4009d3ff6404b77, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/b5c5e16b51e246abb138ac355b8462e8, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/8e6b536e93a44edcaeda844a2d5a4d96, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/1f41ae7c56da4ad7be97ca982de77220, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/876d2831943549049a6f5ec774480268, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/818c1a59c9bf4ff9a7ce8a4330952596, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/577362da24a0451fb0efac2372930329_SeqId_44_] to archive 2023-10-31 05:55:16,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:16,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/9a3967154afa416c97de37a2f0c2922c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/9a3967154afa416c97de37a2f0c2922c 2023-10-31 05:55:16,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/155fc53f5b26460da7077c29dba4e937 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/155fc53f5b26460da7077c29dba4e937 2023-10-31 05:55:16,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/2eaa0e5413de48c6b163eea8c0fce51a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/2eaa0e5413de48c6b163eea8c0fce51a 2023-10-31 05:55:16,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/169ca68f96944969a4009d3ff6404b77 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/169ca68f96944969a4009d3ff6404b77 2023-10-31 05:55:16,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/b5c5e16b51e246abb138ac355b8462e8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/b5c5e16b51e246abb138ac355b8462e8 2023-10-31 05:55:16,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/8e6b536e93a44edcaeda844a2d5a4d96 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/8e6b536e93a44edcaeda844a2d5a4d96 2023-10-31 05:55:16,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/1f41ae7c56da4ad7be97ca982de77220 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/1f41ae7c56da4ad7be97ca982de77220 2023-10-31 05:55:16,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/876d2831943549049a6f5ec774480268 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/876d2831943549049a6f5ec774480268 2023-10-31 05:55:16,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/818c1a59c9bf4ff9a7ce8a4330952596 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/818c1a59c9bf4ff9a7ce8a4330952596 2023-10-31 05:55:16,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/577362da24a0451fb0efac2372930329_SeqId_44_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/577362da24a0451fb0efac2372930329_SeqId_44_ 2023-10-31 05:55:17,101 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f3312a5151d641f59bc4ec91730e37e9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130f3312a5151d641f59bc4ec91730e37e9 2023-10-31 05:55:17,102 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:55:17,126 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6823009aed424e058c24d18cdbb97db2 first=Optional[r00] last=Optional[r8] 2023-10-31 05:55:17,127 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6823009aed424e058c24d18cdbb97db2}] 2023-10-31 05:55:17,129 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6823009aed424e058c24d18cdbb97db2 for inclusion in 809ec7d82e56357140163c2d715145ac/family1 2023-10-31 05:55:17,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-31 05:55:17,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last= 2023-10-31 05:55:17,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:17,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6823009aed424e058c24d18cdbb97db2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9uj6d878m42esfsu07b4rgseqc1tg6g0o2desmv551maldtdhheh156ho34h9fvs/family1/6823009aed424e058c24d18cdbb97db2 2023-10-31 05:55:17,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9uj6d878m42esfsu07b4rgseqc1tg6g0o2desmv551maldtdhheh156ho34h9fvs/family1/6823009aed424e058c24d18cdbb97db2 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/335f92325e754d38b10a0825e57837ee_SeqId_49_ 2023-10-31 05:55:17,138 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9uj6d878m42esfsu07b4rgseqc1tg6g0o2desmv551maldtdhheh156ho34h9fvs/family1/6823009aed424e058c24d18cdbb97db2 into 809ec7d82e56357140163c2d715145ac/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/335f92325e754d38b10a0825e57837ee_SeqId_49_ - updating store file list. 2023-10-31 05:55:17,142 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/335f92325e754d38b10a0825e57837ee_SeqId_49_ into 809ec7d82e56357140163c2d715145ac/family1 2023-10-31 05:55:17,142 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9uj6d878m42esfsu07b4rgseqc1tg6g0o2desmv551maldtdhheh156ho34h9fvs/family1/6823009aed424e058c24d18cdbb97db2 into 809ec7d82e56357140163c2d715145ac/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/335f92325e754d38b10a0825e57837ee_SeqId_49_) 2023-10-31 05:55:17,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9uj6d878m42esfsu07b4rgseqc1tg6g0o2desmv551maldtdhheh156ho34h9fvs/family1/6823009aed424e058c24d18cdbb97db2 2023-10-31 05:55:17,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-31 05:55:17,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-31 05:55:17,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(1912): 809ec7d82e56357140163c2d715145ac/family1 is initiating minor compaction (all files) 2023-10-31 05:55:17,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6bfcfe47; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:55:17,144 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 809ec7d82e56357140163c2d715145ac/family1 in testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:17,144 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/57b62c59bbae461c97b962273787c7b7, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/3d974fa4b2f1491b90e01da4c37299a3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/c22a1000b35a401bab347ee640542852_SeqId_46_, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/335f92325e754d38b10a0825e57837ee_SeqId_49_] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp, totalSize=344.3 K 2023-10-31 05:55:17,145 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 57b62c59bbae461c97b962273787c7b7, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878848969 2023-10-31 05:55:17,145 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 3d974fa4b2f1491b90e01da4c37299a3, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621248969 2023-10-31 05:55:17,145 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting c22a1000b35a401bab347ee640542852_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965248969 2023-10-31 05:55:17,146 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] compactions.Compactor(207): Compacting 335f92325e754d38b10a0825e57837ee_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014848969 2023-10-31 05:55:17,146 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:55:17,146 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:17,147 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120ee9edbf3a84e4fe38dc70563a1650fd1 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120ee9edbf3a84e4fe38dc70563a1650fd1 2023-10-31 05:55:17,148 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511289af5eece41e74ea2ae84a7df927ccd82 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511289af5eece41e74ea2ae84a7df927ccd82 2023-10-31 05:55:17,149 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b3c8d746d2394ed6a042597e698611b4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b3c8d746d2394ed6a042597e698611b4 2023-10-31 05:55:17,149 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-31 05:55:17,149 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-31 05:55:17,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:55:17,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:55:17,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-31 05:55:17,150 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-31 05:55:17,150 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:55:17,152 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-31 05:55:17,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8940 sec 2023-10-31 05:55:17,165 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] throttle.PressureAwareThroughputController(145): 809ec7d82e56357140163c2d715145ac#family1#compaction#166 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-31 05:55:17,192 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/.tmp/family1/c8a8f64d75f24af48db99df407790189 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/c8a8f64d75f24af48db99df407790189 2023-10-31 05:55:17,197 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 809ec7d82e56357140163c2d715145ac/family1 of 809ec7d82e56357140163c2d715145ac into c8a8f64d75f24af48db99df407790189(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:55:17,197 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:17,197 INFO [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1698731717144; duration=0sec 2023-10-31 05:55:17,197 DEBUG [RS:0;jenkins-hbase20:43723-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-31 05:55:17,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/57b62c59bbae461c97b962273787c7b7, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/3d974fa4b2f1491b90e01da4c37299a3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/c22a1000b35a401bab347ee640542852_SeqId_46_, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/335f92325e754d38b10a0825e57837ee_SeqId_49_] to archive 2023-10-31 05:55:17,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:17,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/57b62c59bbae461c97b962273787c7b7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/57b62c59bbae461c97b962273787c7b7 2023-10-31 05:55:17,209 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/3d974fa4b2f1491b90e01da4c37299a3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/3d974fa4b2f1491b90e01da4c37299a3 2023-10-31 05:55:17,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/c22a1000b35a401bab347ee640542852_SeqId_46_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/c22a1000b35a401bab347ee640542852_SeqId_46_ 2023-10-31 05:55:17,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/335f92325e754d38b10a0825e57837ee_SeqId_49_ to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1/335f92325e754d38b10a0825e57837ee_SeqId_49_ 2023-10-31 05:55:17,214 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-10-31 05:55:17,331 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=254 (was 256), OpenFileDescriptor=646 (was 640) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=125 (was 123) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=2221 (was 1183) - AvailableMemoryMB LEAK? - 2023-10-31 05:55:17,344 INFO [Listener at localhost/40291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=254, OpenFileDescriptor=646, MaxFileDescriptor=60000, SystemLoadAverage=125, ProcessCount=169, AvailableMemoryMB=2220 2023-10-31 05:55:17,360 DEBUG [Listener at localhost/40291] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-10-31 05:55:17,417 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC08\xC2F\x0E\xCC)\xE7\xF4\xE8PV&\xAC/\xAF"\x10\xE2\xF1\x99\xD1\xCD\x16;\xD51\x860c\xCF{\x10\xFC*\x10\xF84\x7F\xA2!p\xB5iA\x06zh\xBA\xFF8H2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-31 05:55:17,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-10-31 05:55:17,419 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-10-31 05:55:17,419 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-10-31 05:55:17,420 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-31 05:55:17,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-31 05:55:17,421 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:17,421 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:17,421 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:17,422 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b empty. 2023-10-31 05:55:17,422 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f empty. 2023-10-31 05:55:17,422 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690 empty. 2023-10-31 05:55:17,422 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:17,422 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:17,422 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:17,422 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-10-31 05:55:17,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-31 05:55:17,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-31 05:55:17,830 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-10-31 05:55:17,833 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 17d7630b3bc4a54edc19d20d1c6d2e6b, NAME => 'testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC08\xC2F\x0E\xCC)\xE7\xF4\xE8PV&\xAC/\xAF"\x10\xE2\xF1\x99\xD1\xCD\x16;\xD51\x860c\xCF{\x10\xFC*\x10\xF84\x7F\xA2!p\xB5iA\x06zh\xBA\xFF8H2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:55:17,834 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => cd27d39a6a249e1e3a30c0f1ecf70690, NAME => 'testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC08\xC2F\x0E\xCC)\xE7\xF4\xE8PV&\xAC/\xAF"\x10\xE2\xF1\x99\xD1\xCD\x16;\xD51\x860c\xCF{\x10\xFC*\x10\xF84\x7F\xA2!p\xB5iA\x06zh\xBA\xFF8H2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:55:17,835 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8205c24748dde14e74a6163cd9416e1f, NAME => 'testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC08\xC2F\x0E\xCC)\xE7\xF4\xE8PV&\xAC/\xAF"\x10\xE2\xF1\x99\xD1\xCD\x16;\xD51\x860c\xCF{\x10\xFC*\x10\xF84\x7F\xA2!p\xB5iA\x06zh\xBA\xFF8H2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/.tmp 2023-10-31 05:55:18,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-31 05:55:18,245 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:55:18,245 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:55:18,245 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:55:18,245 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing cd27d39a6a249e1e3a30c0f1ecf70690, disabling compactions & flushes 2023-10-31 05:55:18,246 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 8205c24748dde14e74a6163cd9416e1f, disabling compactions & flushes 2023-10-31 05:55:18,246 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 17d7630b3bc4a54edc19d20d1c6d2e6b, disabling compactions & flushes 2023-10-31 05:55:18,246 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:18,247 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:18,247 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. after waiting 0 ms 2023-10-31 05:55:18,247 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:18,247 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:18,247 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:18,246 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:18,247 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:18,248 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. after waiting 0 ms 2023-10-31 05:55:18,248 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:18,246 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:18,248 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:18,248 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:18,248 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:18,248 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. after waiting 0 ms 2023-10-31 05:55:18,248 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:18,249 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:18,249 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:18,252 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-10-31 05:55:18,253 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698731718253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731718253"}]},"ts":"1698731718253"} 2023-10-31 05:55:18,253 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731718253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731718253"}]},"ts":"1698731718253"} 2023-10-31 05:55:18,253 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731718253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698731718253"}]},"ts":"1698731718253"} 2023-10-31 05:55:18,256 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-31 05:55:18,257 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-31 05:55:18,257 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731718257"}]},"ts":"1698731718257"} 2023-10-31 05:55:18,258 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-10-31 05:55:18,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=17d7630b3bc4a54edc19d20d1c6d2e6b, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8205c24748dde14e74a6163cd9416e1f, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cd27d39a6a249e1e3a30c0f1ecf70690, ASSIGN}] 2023-10-31 05:55:18,263 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=17d7630b3bc4a54edc19d20d1c6d2e6b, ASSIGN 2023-10-31 05:55:18,263 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cd27d39a6a249e1e3a30c0f1ecf70690, ASSIGN 2023-10-31 05:55:18,263 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8205c24748dde14e74a6163cd9416e1f, ASSIGN 2023-10-31 05:55:18,264 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=17d7630b3bc4a54edc19d20d1c6d2e6b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:55:18,264 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cd27d39a6a249e1e3a30c0f1ecf70690, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:55:18,264 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8205c24748dde14e74a6163cd9416e1f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43723,1698731565849; forceNewPlan=false, retain=false 2023-10-31 05:55:18,417 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=8205c24748dde14e74a6163cd9416e1f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:18,417 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=17d7630b3bc4a54edc19d20d1c6d2e6b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:18,417 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698731718416"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731718416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731718416"}]},"ts":"1698731718416"} 2023-10-31 05:55:18,417 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=cd27d39a6a249e1e3a30c0f1ecf70690, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:18,417 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731718417"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731718417"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731718417"}]},"ts":"1698731718417"} 2023-10-31 05:55:18,417 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731718416"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698731718416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698731718416"}]},"ts":"1698731718416"} 2023-10-31 05:55:18,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 8205c24748dde14e74a6163cd9416e1f, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:55:18,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure 17d7630b3bc4a54edc19d20d1c6d2e6b, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:55:18,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure cd27d39a6a249e1e3a30c0f1ecf70690, server=jenkins-hbase20.apache.org,43723,1698731565849}] 2023-10-31 05:55:18,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-31 05:55:18,572 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:18,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:18,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cd27d39a6a249e1e3a30c0f1ecf70690, NAME => 'testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690.', STARTKEY => '2', ENDKEY => ''} 2023-10-31 05:55:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:55:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:18,604 INFO [StoreOpener-cd27d39a6a249e1e3a30c0f1ecf70690-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:18,606 DEBUG [StoreOpener-cd27d39a6a249e1e3a30c0f1ecf70690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1 2023-10-31 05:55:18,606 DEBUG [StoreOpener-cd27d39a6a249e1e3a30c0f1ecf70690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1 2023-10-31 05:55:18,606 INFO [StoreOpener-cd27d39a6a249e1e3a30c0f1ecf70690-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd27d39a6a249e1e3a30c0f1ecf70690 columnFamilyName family1 2023-10-31 05:55:18,607 INFO [StoreOpener-cd27d39a6a249e1e3a30c0f1ecf70690-1] regionserver.HStore(310): Store=cd27d39a6a249e1e3a30c0f1ecf70690/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:55:18,607 INFO [StoreOpener-cd27d39a6a249e1e3a30c0f1ecf70690-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:18,609 DEBUG [StoreOpener-cd27d39a6a249e1e3a30c0f1ecf70690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2 2023-10-31 05:55:18,609 DEBUG [StoreOpener-cd27d39a6a249e1e3a30c0f1ecf70690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2 2023-10-31 05:55:18,609 INFO [StoreOpener-cd27d39a6a249e1e3a30c0f1ecf70690-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd27d39a6a249e1e3a30c0f1ecf70690 columnFamilyName family2 2023-10-31 05:55:18,610 INFO [StoreOpener-cd27d39a6a249e1e3a30c0f1ecf70690-1] regionserver.HStore(310): Store=cd27d39a6a249e1e3a30c0f1ecf70690/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:55:18,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:18,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:18,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:55:18,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:18,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:55:18,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cd27d39a6a249e1e3a30c0f1ecf70690; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65178849, jitterRate=-0.028759464621543884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:55:18,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:18,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690., pid=122, masterSystemTime=1698731718572 2023-10-31 05:55:18,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:18,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:18,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:18,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8205c24748dde14e74a6163cd9416e1f, NAME => 'testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f.', STARTKEY => '1', ENDKEY => '2'} 2023-10-31 05:55:18,618 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=cd27d39a6a249e1e3a30c0f1ecf70690, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:18,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:18,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:55:18,618 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731718617"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731718617"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731718617"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731718617"}]},"ts":"1698731718617"} 2023-10-31 05:55:18,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:18,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:18,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=119 2023-10-31 05:55:18,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure cd27d39a6a249e1e3a30c0f1ecf70690, server=jenkins-hbase20.apache.org,43723,1698731565849 in 198 msec 2023-10-31 05:55:18,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cd27d39a6a249e1e3a30c0f1ecf70690, ASSIGN in 359 msec 2023-10-31 05:55:18,640 INFO [StoreOpener-8205c24748dde14e74a6163cd9416e1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:18,641 DEBUG [StoreOpener-8205c24748dde14e74a6163cd9416e1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1 2023-10-31 05:55:18,641 DEBUG [StoreOpener-8205c24748dde14e74a6163cd9416e1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1 2023-10-31 05:55:18,641 INFO [StoreOpener-8205c24748dde14e74a6163cd9416e1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8205c24748dde14e74a6163cd9416e1f columnFamilyName family1 2023-10-31 05:55:18,642 INFO [StoreOpener-8205c24748dde14e74a6163cd9416e1f-1] regionserver.HStore(310): Store=8205c24748dde14e74a6163cd9416e1f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:55:18,642 INFO [StoreOpener-8205c24748dde14e74a6163cd9416e1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:18,643 DEBUG [StoreOpener-8205c24748dde14e74a6163cd9416e1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2 2023-10-31 05:55:18,643 DEBUG [StoreOpener-8205c24748dde14e74a6163cd9416e1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2 2023-10-31 05:55:18,643 INFO [StoreOpener-8205c24748dde14e74a6163cd9416e1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8205c24748dde14e74a6163cd9416e1f columnFamilyName family2 2023-10-31 05:55:18,644 INFO [StoreOpener-8205c24748dde14e74a6163cd9416e1f-1] regionserver.HStore(310): Store=8205c24748dde14e74a6163cd9416e1f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:55:18,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:18,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:18,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:55:18,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:18,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:55:18,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8205c24748dde14e74a6163cd9416e1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61593889, jitterRate=-0.08217953145503998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:55:18,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:18,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f., pid=120, masterSystemTime=1698731718572 2023-10-31 05:55:18,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:18,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:18,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:18,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17d7630b3bc4a54edc19d20d1c6d2e6b, NAME => 'testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b.', STARTKEY => '', ENDKEY => '1'} 2023-10-31 05:55:18,650 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=8205c24748dde14e74a6163cd9416e1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:18,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:18,651 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698731718650"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731718650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731718650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731718650"}]},"ts":"1698731718650"} 2023-10-31 05:55:18,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-31 05:55:18,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:18,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:18,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=118 2023-10-31 05:55:18,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 8205c24748dde14e74a6163cd9416e1f, server=jenkins-hbase20.apache.org,43723,1698731565849 in 233 msec 2023-10-31 05:55:18,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8205c24748dde14e74a6163cd9416e1f, ASSIGN in 392 msec 2023-10-31 05:55:18,670 INFO [StoreOpener-17d7630b3bc4a54edc19d20d1c6d2e6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:18,671 DEBUG [StoreOpener-17d7630b3bc4a54edc19d20d1c6d2e6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1 2023-10-31 05:55:18,671 DEBUG [StoreOpener-17d7630b3bc4a54edc19d20d1c6d2e6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1 2023-10-31 05:55:18,672 INFO [StoreOpener-17d7630b3bc4a54edc19d20d1c6d2e6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17d7630b3bc4a54edc19d20d1c6d2e6b columnFamilyName family1 2023-10-31 05:55:18,672 INFO [StoreOpener-17d7630b3bc4a54edc19d20d1c6d2e6b-1] regionserver.HStore(310): Store=17d7630b3bc4a54edc19d20d1c6d2e6b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:55:18,673 INFO [StoreOpener-17d7630b3bc4a54edc19d20d1c6d2e6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:18,674 DEBUG [StoreOpener-17d7630b3bc4a54edc19d20d1c6d2e6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2 2023-10-31 05:55:18,674 DEBUG [StoreOpener-17d7630b3bc4a54edc19d20d1c6d2e6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2 2023-10-31 05:55:18,674 INFO [StoreOpener-17d7630b3bc4a54edc19d20d1c6d2e6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17d7630b3bc4a54edc19d20d1c6d2e6b columnFamilyName family2 2023-10-31 05:55:18,674 INFO [StoreOpener-17d7630b3bc4a54edc19d20d1c6d2e6b-1] regionserver.HStore(310): Store=17d7630b3bc4a54edc19d20d1c6d2e6b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-31 05:55:18,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:18,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:18,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-31 05:55:18,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:18,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-31 05:55:18,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 17d7630b3bc4a54edc19d20d1c6d2e6b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60484382, jitterRate=-0.09871247410774231}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-31 05:55:18,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:18,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b., pid=121, masterSystemTime=1698731718572 2023-10-31 05:55:18,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:18,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:18,680 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=17d7630b3bc4a54edc19d20d1c6d2e6b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:18,680 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698731718680"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698731718680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698731718680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698731718680"}]},"ts":"1698731718680"} 2023-10-31 05:55:18,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=117 2023-10-31 05:55:18,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure 17d7630b3bc4a54edc19d20d1c6d2e6b, server=jenkins-hbase20.apache.org,43723,1698731565849 in 261 msec 2023-10-31 05:55:18,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-10-31 05:55:18,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=17d7630b3bc4a54edc19d20d1c6d2e6b, ASSIGN in 421 msec 2023-10-31 05:55:18,683 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-31 05:55:18,683 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698731718683"}]},"ts":"1698731718683"} 2023-10-31 05:55:18,684 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-10-31 05:55:18,686 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-10-31 05:55:18,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2690 sec 2023-10-31 05:55:19,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-31 05:55:19,529 INFO [Listener at localhost/40291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-10-31 05:55:19,542 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:19,543 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:19,543 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:19,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:19,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-31 05:55:19,548 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-31 05:55:19,548 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:19,548 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-31 05:55:19,548 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-31 05:55:19,549 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:19,549 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:19,550 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:19,550 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:19,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:19,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:19,550 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:19,551 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:19,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:19,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:19,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:19,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:19,552 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-31 05:55:19,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-31 05:55:19,552 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-31 05:55:19,552 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:19,552 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-31 05:55:19,553 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:19,553 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:19,553 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:55:19,553 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:19,553 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. started... 2023-10-31 05:55:19,553 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. started... 2023-10-31 05:55:19,553 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:19,554 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. started... 2023-10-31 05:55:19,555 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 17d7630b3bc4a54edc19d20d1c6d2e6b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-31 05:55:19,554 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cd27d39a6a249e1e3a30c0f1ecf70690 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-31 05:55:19,556 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 8205c24748dde14e74a6163cd9416e1f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-31 05:55:20,007 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031b45e2619e25e425eb05628fe62db1338 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231031b45e2619e25e425eb05628fe62db1338 2023-10-31 05:55:20,014 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031f6dbb527ea884b9a8f45cbbec9217040 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231031f6dbb527ea884b9a8f45cbbec9217040 2023-10-31 05:55:20,014 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310310bd1ab33f4264c78ba8cbb0f7223263e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310310bd1ab33f4264c78ba8cbb0f7223263e 2023-10-31 05:55:20,420 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/a3aed570d44543c897faa449ea79eb9a 2023-10-31 05:55:20,427 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/1fd046d9bd294ff883227e7101787ff5 2023-10-31 05:55:20,427 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/4a4c6887f82c4506a466bc4d42ae8d04 2023-10-31 05:55:20,855 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031dc9b98f1809c409fb304e23306ec8625 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231031dc9b98f1809c409fb304e23306ec8625 2023-10-31 05:55:20,860 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310315dd0c1a1f8d04438bce16961a8ffcd01 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310315dd0c1a1f8d04438bce16961a8ffcd01 2023-10-31 05:55:20,863 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/9042c22a33764643a5caeabd653ddbc3 2023-10-31 05:55:20,867 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031bc45090663c24a1fbc252a2b287dbcfe to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231031bc45090663c24a1fbc252a2b287dbcfe 2023-10-31 05:55:20,868 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/a3aed570d44543c897faa449ea79eb9a as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/a3aed570d44543c897faa449ea79eb9a 2023-10-31 05:55:20,890 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/a3aed570d44543c897faa449ea79eb9a, entries=4, sequenceid=5, filesize=5.5 K 2023-10-31 05:55:20,891 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/9042c22a33764643a5caeabd653ddbc3 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/9042c22a33764643a5caeabd653ddbc3 2023-10-31 05:55:20,894 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/9042c22a33764643a5caeabd653ddbc3, entries=2, sequenceid=5, filesize=5.1 K 2023-10-31 05:55:20,894 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 17d7630b3bc4a54edc19d20d1c6d2e6b in 1339ms, sequenceid=5, compaction requested=false 2023-10-31 05:55:20,894 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-10-31 05:55:20,895 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:20,895 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:20,895 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:55:21,268 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/2898ca3a309f4cefa0e458dac424df21 2023-10-31 05:55:21,273 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/37e697bbc66c423da8ef48edab631233 2023-10-31 05:55:21,280 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/4a4c6887f82c4506a466bc4d42ae8d04 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/4a4c6887f82c4506a466bc4d42ae8d04 2023-10-31 05:55:21,282 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/1fd046d9bd294ff883227e7101787ff5 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/1fd046d9bd294ff883227e7101787ff5 2023-10-31 05:55:21,313 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/1fd046d9bd294ff883227e7101787ff5, entries=4, sequenceid=5, filesize=5.5 K 2023-10-31 05:55:21,313 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/4a4c6887f82c4506a466bc4d42ae8d04, entries=4, sequenceid=5, filesize=5.5 K 2023-10-31 05:55:21,314 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/37e697bbc66c423da8ef48edab631233 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/37e697bbc66c423da8ef48edab631233 2023-10-31 05:55:21,314 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/2898ca3a309f4cefa0e458dac424df21 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2898ca3a309f4cefa0e458dac424df21 2023-10-31 05:55:21,317 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/37e697bbc66c423da8ef48edab631233, entries=2, sequenceid=5, filesize=5.1 K 2023-10-31 05:55:21,317 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2898ca3a309f4cefa0e458dac424df21, entries=2, sequenceid=5, filesize=5.1 K 2023-10-31 05:55:21,317 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cd27d39a6a249e1e3a30c0f1ecf70690 in 1763ms, sequenceid=5, compaction requested=false 2023-10-31 05:55:21,317 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8205c24748dde14e74a6163cd9416e1f in 1761ms, sequenceid=5, compaction requested=false 2023-10-31 05:55:21,318 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:21,318 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:21,318 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:21,318 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:21,318 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:55:21,318 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:55:21,318 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:55:21,318 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,318 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-31 05:55:21,318 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-31 05:55:21,319 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:21,319 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:21,319 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:21,319 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:21,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-31 05:55:21,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@429c08b3[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:21,320 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-31 05:55:21,320 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:21,321 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:21,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:21,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:21,321 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-31 05:55:21,321 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-31 05:55:21,321 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:21,321 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,321 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:21,322 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-31 05:55:21,322 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,322 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:21,322 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-31 05:55:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:21,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-31 05:55:21,324 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-31 05:55:21,324 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:21,324 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:21,324 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-31 05:55:21,324 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:21,325 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:21,325 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:21,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:21,325 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:21,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:21,325 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:21,326 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:21,328 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-31 05:55:21,328 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:21,328 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:21,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:21,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:21,328 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:21,428 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:21,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:21,432 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:21,433 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:21,433 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:21,439 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:21,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:21,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-31 05:55:21,443 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-31 05:55:21,443 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:21,443 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-31 05:55:21,443 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-31 05:55:21,443 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:21,443 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:21,444 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:21,444 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:21,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:21,444 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:21,444 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:21,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:21,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:21,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:21,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:21,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-31 05:55:21,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-31 05:55:21,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-31 05:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-31 05:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-31 05:55:21,447 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:21,447 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:55:21,447 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:21,447 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:21,447 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. started... 2023-10-31 05:55:21,447 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:21,448 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. started... 2023-10-31 05:55:21,447 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. started... 2023-10-31 05:55:21,448 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cd27d39a6a249e1e3a30c0f1ecf70690 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-31 05:55:21,448 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 8205c24748dde14e74a6163cd9416e1f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-31 05:55:21,448 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 17d7630b3bc4a54edc19d20d1c6d2e6b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-31 05:55:21,897 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031977ecd46d22d4c449744c11dfdb0d7fb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231031977ecd46d22d4c449744c11dfdb0d7fb 2023-10-31 05:55:21,905 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103172f3f5849bf34f96a475c819c95e08da to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103172f3f5849bf34f96a475c819c95e08da 2023-10-31 05:55:21,906 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031f16b2880b66e44948f3e56df36777bac to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231031f16b2880b66e44948f3e56df36777bac 2023-10-31 05:55:22,311 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/9a484d9ef0d34949b3543413ed34e730 2023-10-31 05:55:22,318 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/af8ff1017f854aeaa1d27c8e76f51101 2023-10-31 05:55:22,319 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/88a3f30361e542b5a055a363779ed5da 2023-10-31 05:55:22,378 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310314412fa3d92594f0f86f3dbc3b8e3d00b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310314412fa3d92594f0f86f3dbc3b8e3d00b 2023-10-31 05:55:22,388 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/277d89ba437d4243b24d2a2a8aa5c2c4 2023-10-31 05:55:22,393 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/af8ff1017f854aeaa1d27c8e76f51101 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/af8ff1017f854aeaa1d27c8e76f51101 2023-10-31 05:55:22,420 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/af8ff1017f854aeaa1d27c8e76f51101, entries=4, sequenceid=9, filesize=5.5 K 2023-10-31 05:55:22,421 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/277d89ba437d4243b24d2a2a8aa5c2c4 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/277d89ba437d4243b24d2a2a8aa5c2c4 2023-10-31 05:55:22,424 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/277d89ba437d4243b24d2a2a8aa5c2c4, entries=2, sequenceid=9, filesize=5.1 K 2023-10-31 05:55:22,425 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8205c24748dde14e74a6163cd9416e1f in 977ms, sequenceid=9, compaction requested=false 2023-10-31 05:55:22,425 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:22,426 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:22,426 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:55:22,774 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310311e605034c2d244acaf3f9d5800b8b5e5 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202310311e605034c2d244acaf3f9d5800b8b5e5 2023-10-31 05:55:22,790 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310314ba25a40ad4e4ce49bd8e89eb0c321ae to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310314ba25a40ad4e4ce49bd8e89eb0c321ae 2023-10-31 05:55:23,179 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/f8ae6541b2ed43e1b0497442b4864c39 2023-10-31 05:55:23,182 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/9a484d9ef0d34949b3543413ed34e730 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/9a484d9ef0d34949b3543413ed34e730 2023-10-31 05:55:23,195 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/8b5c54e6a0f541d6a912d72b5f0f515d 2023-10-31 05:55:23,199 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/88a3f30361e542b5a055a363779ed5da as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/88a3f30361e542b5a055a363779ed5da 2023-10-31 05:55:23,203 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/9a484d9ef0d34949b3543413ed34e730, entries=4, sequenceid=9, filesize=5.5 K 2023-10-31 05:55:23,204 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/f8ae6541b2ed43e1b0497442b4864c39 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/f8ae6541b2ed43e1b0497442b4864c39 2023-10-31 05:55:23,207 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/f8ae6541b2ed43e1b0497442b4864c39, entries=2, sequenceid=9, filesize=5.1 K 2023-10-31 05:55:23,207 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 17d7630b3bc4a54edc19d20d1c6d2e6b in 1759ms, sequenceid=9, compaction requested=false 2023-10-31 05:55:23,207 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:23,208 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:23,208 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:55:23,228 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/88a3f30361e542b5a055a363779ed5da, entries=4, sequenceid=9, filesize=5.5 K 2023-10-31 05:55:23,229 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/8b5c54e6a0f541d6a912d72b5f0f515d as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/8b5c54e6a0f541d6a912d72b5f0f515d 2023-10-31 05:55:23,233 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/8b5c54e6a0f541d6a912d72b5f0f515d, entries=2, sequenceid=9, filesize=5.1 K 2023-10-31 05:55:23,234 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cd27d39a6a249e1e3a30c0f1ecf70690 in 1786ms, sequenceid=9, compaction requested=false 2023-10-31 05:55:23,234 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:23,234 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:23,234 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:55:23,234 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:55:23,234 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,234 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-31 05:55:23,234 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-31 05:55:23,235 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,235 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:23,236 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:23,236 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:23,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-31 05:55:23,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@708e7af9[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:23,237 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-31 05:55:23,237 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:23,237 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:23,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:23,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:23,237 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-31 05:55:23,237 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-31 05:55:23,237 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:23,237 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,237 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:23,238 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,238 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-31 05:55:23,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:23,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:23,238 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:23,238 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-31 05:55:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:23,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-31 05:55:23,240 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-31 05:55:23,240 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:23,240 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:23,241 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-31 05:55:23,241 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:23,242 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:23,242 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:23,242 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:23,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:23,242 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:23,243 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,245 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,245 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:23,245 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:23,245 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:23,245 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:23,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:23,245 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:23,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-31 05:55:23,245 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-31 05:55:23,245 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:23,245 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:23,245 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:23,245 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:23,245 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:23,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:23,246 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:23,246 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:23,346 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:23,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:23,348 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:23,348 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:23,348 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:23,351 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:23,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:23,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-31 05:55:23,353 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-31 05:55:23,353 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:23,353 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-31 05:55:23,353 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-31 05:55:23,353 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:23,353 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:23,354 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,354 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:23,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:23,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:23,354 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:23,354 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:23,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:23,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:23,355 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-31 05:55:23,356 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-31 05:55:23,356 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-31 05:55:23,356 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-31 05:55:23,356 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:23,356 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-31 05:55:23,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:23,356 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. started... 2023-10-31 05:55:23,357 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 17d7630b3bc4a54edc19d20d1c6d2e6b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-31 05:55:23,360 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:23,360 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:55:23,360 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:23,360 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. started... 2023-10-31 05:55:23,360 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:23,361 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 8205c24748dde14e74a6163cd9416e1f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-31 05:55:23,360 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. started... 2023-10-31 05:55:23,361 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cd27d39a6a249e1e3a30c0f1ecf70690 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-31 05:55:23,817 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231031f57d53285f984c8cac381d7050c3e999 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231031f57d53285f984c8cac381d7050c3e999 2023-10-31 05:55:23,820 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103175b4fa6045eb4c75b4f34f2ec0480859 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103175b4fa6045eb4c75b4f34f2ec0480859 2023-10-31 05:55:23,820 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310311acb488c02b541458e463317713a508f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310311acb488c02b541458e463317713a508f 2023-10-31 05:55:23,830 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/10ae33f09786419da4b2caf24c623589 2023-10-31 05:55:24,123 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-31 05:55:24,234 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/80534e103d6542398f0e394c93f28e77 2023-10-31 05:55:24,239 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/5aa6a16581cf47f99e6974352277b4a9 2023-10-31 05:55:24,264 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031e5606d872d544fa98a7cc2cd48145949 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231031e5606d872d544fa98a7cc2cd48145949 2023-10-31 05:55:24,264 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103144bd78aba6ce4842ad893799537d4db7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023103144bd78aba6ce4842ad893799537d4db7 2023-10-31 05:55:24,271 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/990b08272d654be0a6276365c3ae4c86 2023-10-31 05:55:24,271 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/8ac3bf83485c4692ae709fd01a3eb8fa 2023-10-31 05:55:24,274 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/80534e103d6542398f0e394c93f28e77 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/80534e103d6542398f0e394c93f28e77 2023-10-31 05:55:24,274 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/10ae33f09786419da4b2caf24c623589 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/10ae33f09786419da4b2caf24c623589 2023-10-31 05:55:24,284 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231031d6e5f24325a5417d830dbc21d8464976 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231031d6e5f24325a5417d830dbc21d8464976 2023-10-31 05:55:24,295 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/80534e103d6542398f0e394c93f28e77, entries=4, sequenceid=13, filesize=5.5 K 2023-10-31 05:55:24,296 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/990b08272d654be0a6276365c3ae4c86 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/990b08272d654be0a6276365c3ae4c86 2023-10-31 05:55:24,299 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/10ae33f09786419da4b2caf24c623589, entries=4, sequenceid=13, filesize=5.5 K 2023-10-31 05:55:24,299 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/8ac3bf83485c4692ae709fd01a3eb8fa as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/8ac3bf83485c4692ae709fd01a3eb8fa 2023-10-31 05:55:24,301 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/990b08272d654be0a6276365c3ae4c86, entries=2, sequenceid=13, filesize=5.1 K 2023-10-31 05:55:24,302 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cd27d39a6a249e1e3a30c0f1ecf70690 in 941ms, sequenceid=13, compaction requested=true 2023-10-31 05:55:24,302 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:24,302 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:24,302 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:55:24,303 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/8ac3bf83485c4692ae709fd01a3eb8fa, entries=2, sequenceid=13, filesize=5.1 K 2023-10-31 05:55:24,303 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8205c24748dde14e74a6163cd9416e1f in 942ms, sequenceid=13, compaction requested=true 2023-10-31 05:55:24,303 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:24,303 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:24,303 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:55:24,697 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/e2d1d559bb17489cacb9e20095f7171c 2023-10-31 05:55:24,702 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/5aa6a16581cf47f99e6974352277b4a9 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/5aa6a16581cf47f99e6974352277b4a9 2023-10-31 05:55:24,732 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/5aa6a16581cf47f99e6974352277b4a9, entries=4, sequenceid=13, filesize=5.5 K 2023-10-31 05:55:24,733 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/e2d1d559bb17489cacb9e20095f7171c as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/e2d1d559bb17489cacb9e20095f7171c 2023-10-31 05:55:24,737 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/e2d1d559bb17489cacb9e20095f7171c, entries=2, sequenceid=13, filesize=5.1 K 2023-10-31 05:55:24,738 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 17d7630b3bc4a54edc19d20d1c6d2e6b in 1382ms, sequenceid=13, compaction requested=true 2023-10-31 05:55:24,738 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:24,738 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:24,738 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:55:24,738 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:55:24,738 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,738 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-31 05:55:24,739 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-31 05:55:24,740 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:24,740 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:24,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:24,740 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:24,740 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:24,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:24,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:24,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:24,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:24,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-31 05:55:24,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@315988db[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:24,741 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-31 05:55:24,741 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:24,742 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:24,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:24,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:24,742 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-31 05:55:24,742 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-31 05:55:24,742 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:24,742 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,742 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:24,743 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-31 05:55:24,743 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,743 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:24,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,743 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-31 05:55:24,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:24,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:24,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:24,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:24,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:24,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-31 05:55:24,745 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-31 05:55:24,745 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:24,745 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:24,745 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-31 05:55:24,745 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:24,746 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:24,746 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:24,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:24,746 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:24,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:24,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:24,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:24,748 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:24,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,749 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:24,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,751 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,751 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:24,751 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:24,751 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,751 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:24,751 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:24,751 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-31 05:55:24,751 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:24,751 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:24,751 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:24,752 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:24,752 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:24,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:24,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:24,752 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:24,752 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:24,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:24,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:24,852 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:24,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:24,854 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:24,854 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:24,854 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. with WAL disabled. Data may be lost in the event of a crash. 2023-10-31 05:55:24,857 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:24,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:24,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-31 05:55:24,859 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-31 05:55:24,859 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:24,859 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-31 05:55:24,859 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-31 05:55:24,859 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:24,859 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:24,860 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:24,860 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:24,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:24,860 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:24,860 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:24,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:24,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:24,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:24,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:24,861 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-31 05:55:24,861 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-31 05:55:24,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-31 05:55:24,861 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-31 05:55:24,861 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:24,861 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-31 05:55:24,862 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:24,862 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. started... 2023-10-31 05:55:24,862 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 17d7630b3bc4a54edc19d20d1c6d2e6b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-31 05:55:24,866 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:24,866 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:55:24,866 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:24,866 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:24,866 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. started... 2023-10-31 05:55:24,867 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. started... 2023-10-31 05:55:24,867 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cd27d39a6a249e1e3a30c0f1ecf70690 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-31 05:55:24,867 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 8205c24748dde14e74a6163cd9416e1f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-31 05:55:24,955 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031808cfb1282104597b1fe3429e1edc18d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231031808cfb1282104597b1fe3429e1edc18d 2023-10-31 05:55:25,324 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103156c4d89d184a46c192b6adca124826c2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103156c4d89d184a46c192b6adca124826c2 2023-10-31 05:55:25,332 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103151f153f6ad7c4eee84956270ef4d0ecf to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103151f153f6ad7c4eee84956270ef4d0ecf 2023-10-31 05:55:25,359 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/1d9da5cb88394143b5d2466a5dd98829 2023-10-31 05:55:25,377 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/14d3d51bbb7f4ab5a04fd91827ac50e0 2023-10-31 05:55:25,408 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031a784f44907fe42fa90717067e314e5a1 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231031a784f44907fe42fa90717067e314e5a1 2023-10-31 05:55:25,756 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/80c5c443d85c45d0976338ae940765d7 2023-10-31 05:55:25,795 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310312736f6e7ea184fe1bb1d2d0ebb3b00fc to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202310312736f6e7ea184fe1bb1d2d0ebb3b00fc 2023-10-31 05:55:25,813 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/2d626f515cb54c7685b746639d363aa2 2023-10-31 05:55:25,817 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/14d3d51bbb7f4ab5a04fd91827ac50e0 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/14d3d51bbb7f4ab5a04fd91827ac50e0 2023-10-31 05:55:25,838 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/14d3d51bbb7f4ab5a04fd91827ac50e0, entries=4, sequenceid=17, filesize=5.5 K 2023-10-31 05:55:25,838 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/2d626f515cb54c7685b746639d363aa2 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2d626f515cb54c7685b746639d363aa2 2023-10-31 05:55:25,842 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2d626f515cb54c7685b746639d363aa2, entries=2, sequenceid=17, filesize=5.1 K 2023-10-31 05:55:25,843 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cd27d39a6a249e1e3a30c0f1ecf70690 in 976ms, sequenceid=17, compaction requested=true 2023-10-31 05:55:25,843 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:25,843 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:25,843 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:55:26,184 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310314ca55cc77b5e4ef8accc999972699b10 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310314ca55cc77b5e4ef8accc999972699b10 2023-10-31 05:55:26,200 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/98d0a56991de4053a2cd5cebbe597c6a 2023-10-31 05:55:26,204 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/1d9da5cb88394143b5d2466a5dd98829 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/1d9da5cb88394143b5d2466a5dd98829 2023-10-31 05:55:26,233 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/1d9da5cb88394143b5d2466a5dd98829, entries=4, sequenceid=17, filesize=5.5 K 2023-10-31 05:55:26,234 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/98d0a56991de4053a2cd5cebbe597c6a as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/98d0a56991de4053a2cd5cebbe597c6a 2023-10-31 05:55:26,238 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/98d0a56991de4053a2cd5cebbe597c6a, entries=2, sequenceid=17, filesize=5.1 K 2023-10-31 05:55:26,239 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 17d7630b3bc4a54edc19d20d1c6d2e6b in 1377ms, sequenceid=17, compaction requested=true 2023-10-31 05:55:26,239 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:26,239 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:26,239 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:55:26,594 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/c346cffec4d7437984deaff2b2a3f362 2023-10-31 05:55:26,598 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/80c5c443d85c45d0976338ae940765d7 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/80c5c443d85c45d0976338ae940765d7 2023-10-31 05:55:26,622 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/80c5c443d85c45d0976338ae940765d7, entries=4, sequenceid=17, filesize=5.5 K 2023-10-31 05:55:26,622 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/c346cffec4d7437984deaff2b2a3f362 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/c346cffec4d7437984deaff2b2a3f362 2023-10-31 05:55:26,628 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/c346cffec4d7437984deaff2b2a3f362, entries=2, sequenceid=17, filesize=5.1 K 2023-10-31 05:55:26,629 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8205c24748dde14e74a6163cd9416e1f in 1762ms, sequenceid=17, compaction requested=true 2023-10-31 05:55:26,629 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:26,629 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:26,629 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:55:26,629 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:55:26,629 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,629 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-31 05:55:26,629 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-31 05:55:26,630 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:26,630 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:26,630 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:26,630 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:26,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:26,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:26,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-31 05:55:26,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@814555[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:26,632 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-31 05:55:26,632 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:26,632 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:26,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:26,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:26,632 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-31 05:55:26,633 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-31 05:55:26,633 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:26,633 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,633 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:26,633 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,633 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-31 05:55:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:26,633 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:26,634 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-31 05:55:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:26,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-31 05:55:26,639 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-31 05:55:26,639 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:26,639 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:26,639 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-31 05:55:26,639 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:26,649 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:26,649 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:26,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:26,650 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:26,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:26,650 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:26,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:26,651 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,652 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,652 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:26,652 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:26,652 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:26,652 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-31 05:55:26,652 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:26,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-31 05:55:26,652 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,652 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:26,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:26,652 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:26,652 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:26,653 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:26,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:26,652 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:26,653 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:26,653 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:26,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:26,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:26,753 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:26,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:26,770 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:55:26,777 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:55:26,783 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:55:26,784 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:55:26,875 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-31 05:55:26,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-31 05:55:26,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-31 05:55:26,877 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-31 05:55:26,877 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:26,877 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-31 05:55:26,877 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-31 05:55:26,877 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:26,877 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:26,878 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,878 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:26,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:26,879 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:26,879 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-31 05:55:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:26,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-31 05:55:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:26,879 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-31 05:55:26,879 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-31 05:55:26,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-31 05:55:26,880 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-31 05:55:26,880 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-31 05:55:26,880 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-31 05:55:26,880 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:26,880 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. started... 2023-10-31 05:55:26,880 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:26,880 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-31 05:55:26,880 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 17d7630b3bc4a54edc19d20d1c6d2e6b 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-31 05:55:26,880 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. started... 2023-10-31 05:55:26,880 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:26,880 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing cd27d39a6a249e1e3a30c0f1ecf70690 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-31 05:55:26,880 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-31 05:55:26,880 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. started... 2023-10-31 05:55:26,880 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 8205c24748dde14e74a6163cd9416e1f 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-31 05:55:26,919 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/d43b393b311842ff8a4fb42ac6f1cd6b 2023-10-31 05:55:26,937 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d43b393b311842ff8a4fb42ac6f1cd6b 2023-10-31 05:55:27,350 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/2e9ca5bd1656436a908335db3481dc70 2023-10-31 05:55:27,353 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e9ca5bd1656436a908335db3481dc70 2023-10-31 05:55:27,353 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/d43b393b311842ff8a4fb42ac6f1cd6b as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/d43b393b311842ff8a4fb42ac6f1cd6b 2023-10-31 05:55:27,383 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d43b393b311842ff8a4fb42ac6f1cd6b 2023-10-31 05:55:27,383 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/d43b393b311842ff8a4fb42ac6f1cd6b, entries=3, sequenceid=23, filesize=5.2 K 2023-10-31 05:55:27,384 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/2e9ca5bd1656436a908335db3481dc70 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/2e9ca5bd1656436a908335db3481dc70 2023-10-31 05:55:27,389 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e9ca5bd1656436a908335db3481dc70 2023-10-31 05:55:27,389 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/2e9ca5bd1656436a908335db3481dc70, entries=1, sequenceid=23, filesize=5.0 K 2023-10-31 05:55:27,390 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8205c24748dde14e74a6163cd9416e1f in 510ms, sequenceid=23, compaction requested=true 2023-10-31 05:55:27,390 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:27,390 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:27,390 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-31 05:55:27,721 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/7b8ac819f5b44ce3a4cf49c3c58e4746 2023-10-31 05:55:27,722 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/e275b046de0949fea2c1b3f742508e1e 2023-10-31 05:55:27,744 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b8ac819f5b44ce3a4cf49c3c58e4746 2023-10-31 05:55:27,747 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e275b046de0949fea2c1b3f742508e1e 2023-10-31 05:55:28,155 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/2b98b6aee6f94353a13af6ffc1ef82af 2023-10-31 05:55:28,160 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b98b6aee6f94353a13af6ffc1ef82af 2023-10-31 05:55:28,161 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/7b8ac819f5b44ce3a4cf49c3c58e4746 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/7b8ac819f5b44ce3a4cf49c3c58e4746 2023-10-31 05:55:28,192 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b8ac819f5b44ce3a4cf49c3c58e4746 2023-10-31 05:55:28,192 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/7b8ac819f5b44ce3a4cf49c3c58e4746, entries=3, sequenceid=23, filesize=5.2 K 2023-10-31 05:55:28,193 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/2b98b6aee6f94353a13af6ffc1ef82af as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2b98b6aee6f94353a13af6ffc1ef82af 2023-10-31 05:55:28,196 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b98b6aee6f94353a13af6ffc1ef82af 2023-10-31 05:55:28,196 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2b98b6aee6f94353a13af6ffc1ef82af, entries=1, sequenceid=23, filesize=5.0 K 2023-10-31 05:55:28,197 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cd27d39a6a249e1e3a30c0f1ecf70690 in 1317ms, sequenceid=23, compaction requested=true 2023-10-31 05:55:28,197 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:28,197 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:28,197 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-31 05:55:28,560 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/81db5fd585914ac4b1e4478cb8381e24 2023-10-31 05:55:28,584 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81db5fd585914ac4b1e4478cb8381e24 2023-10-31 05:55:28,584 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:55:28,584 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/e275b046de0949fea2c1b3f742508e1e as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/e275b046de0949fea2c1b3f742508e1e 2023-10-31 05:55:28,584 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30342cf3 to 127.0.0.1:64652 2023-10-31 05:55:28,584 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:55:28,585 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:55:28,585 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f839d17 to 127.0.0.1:64652 2023-10-31 05:55:28,585 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:55:28,602 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e275b046de0949fea2c1b3f742508e1e 2023-10-31 05:55:28,603 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/e275b046de0949fea2c1b3f742508e1e, entries=3, sequenceid=23, filesize=5.2 K 2023-10-31 05:55:28,603 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/81db5fd585914ac4b1e4478cb8381e24 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/81db5fd585914ac4b1e4478cb8381e24 2023-10-31 05:55:28,607 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81db5fd585914ac4b1e4478cb8381e24 2023-10-31 05:55:28,607 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/81db5fd585914ac4b1e4478cb8381e24, entries=1, sequenceid=23, filesize=5.0 K 2023-10-31 05:55:28,608 INFO [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 17d7630b3bc4a54edc19d20d1c6d2e6b in 1728ms, sequenceid=23, compaction requested=true 2023-10-31 05:55:28,608 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:28,608 DEBUG [rs(jenkins-hbase20.apache.org,43723,1698731565849)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:28,608 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-31 05:55:28,608 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-31 05:55:28,608 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,608 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-31 05:55:28,608 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-31 05:55:28,609 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,609 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:28,609 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:28,609 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-31 05:55:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:28,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43723,1698731565849' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-31 05:55:28,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@227a1c66[Count = 0] remaining members to acquire global barrier 2023-10-31 05:55:28,611 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-31 05:55:28,611 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:28,611 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:28,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:28,611 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-31 05:55:28,611 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-31 05:55:28,611 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43723,1698731565849' in zk 2023-10-31 05:55:28,611 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,611 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-31 05:55:28,612 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,612 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-31 05:55:28,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:28,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:28,612 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:28,612 DEBUG [member: 'jenkins-hbase20.apache.org,43723,1698731565849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-31 05:55:28,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:28,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43723,1698731565849': 2023-10-31 05:55:28,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43723,1698731565849' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-31 05:55:28,614 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-31 05:55:28,614 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-31 05:55:28,614 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-31 05:55:28,614 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-31 05:55:28,614 INFO [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-31 05:55:28,615 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:28,615 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-31 05:55:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-31 05:55:28,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:28,615 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:28,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-31 05:55:28,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:28,616 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-31 05:55:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:28,616 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-31 05:55:28,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-31 05:55:28,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,617 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,618 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-31 05:55:28,618 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:28,618 DEBUG [(jenkins-hbase20.apache.org,42133,1698731564798)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-31 05:55:28,618 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-31 05:55:28,618 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-31 05:55:28,618 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-31 05:55:28,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-31 05:55:28,618 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-31 05:55:28,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-31 05:55:28,618 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:28,618 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:28,618 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-31 05:55:28,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-31 05:55:28,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-31 05:55:28,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-31 05:55:28,618 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-31 05:55:28,618 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-31 05:55:28,618 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-31 05:55:28,718 DEBUG [Listener at localhost/40291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-31 05:55:28,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42133] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-31 05:55:28,720 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:55:28,720 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): 17d7630b3bc4a54edc19d20d1c6d2e6b/family1 is initiating major compaction (all files) 2023-10-31 05:55:28,720 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:55:28,721 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:55:28,721 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of 17d7630b3bc4a54edc19d20d1c6d2e6b/family1 in testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:28,721 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/a3aed570d44543c897faa449ea79eb9a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/9a484d9ef0d34949b3543413ed34e730, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/5aa6a16581cf47f99e6974352277b4a9, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/1d9da5cb88394143b5d2466a5dd98829, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/e275b046de0949fea2c1b3f742508e1e] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp, totalSize=27.1 K 2023-10-31 05:55:28,722 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting a3aed570d44543c897faa449ea79eb9a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731719542 2023-10-31 05:55:28,723 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 9a484d9ef0d34949b3543413ed34e730, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731721432 2023-10-31 05:55:28,724 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 5aa6a16581cf47f99e6974352277b4a9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731723348 2023-10-31 05:55:28,725 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 1d9da5cb88394143b5d2466a5dd98829, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731724854 2023-10-31 05:55:28,726 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting e275b046de0949fea2c1b3f742508e1e, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:55:28,745 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): 17d7630b3bc4a54edc19d20d1c6d2e6b#family1#compaction#197 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:55:29,185 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310314bd3a27da53042fa8782a59a2420ebb0_del 2023-10-31 05:55:29,185 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310314bd3a27da53042fa8782a59a2420ebb0_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310314bd3a27da53042fa8782a59a2420ebb0_del 2023-10-31 05:55:30,050 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c0508854e464428be827a98131d3cb0 2023-10-31 05:55:30,051 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family1/5c0508854e464428be827a98131d3cb0 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/5c0508854e464428be827a98131d3cb0 2023-10-31 05:55:30,069 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c0508854e464428be827a98131d3cb0 2023-10-31 05:55:30,070 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 17d7630b3bc4a54edc19d20d1c6d2e6b/family1 of 17d7630b3bc4a54edc19d20d1c6d2e6b into 5c0508854e464428be827a98131d3cb0(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:55:30,070 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:30,070 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:55:30,070 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): 17d7630b3bc4a54edc19d20d1c6d2e6b/family2 is initiating major compaction (all files) 2023-10-31 05:55:30,070 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:55:30,070 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:55:30,070 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of 17d7630b3bc4a54edc19d20d1c6d2e6b/family2 in testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:30,070 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/9042c22a33764643a5caeabd653ddbc3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/f8ae6541b2ed43e1b0497442b4864c39, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/e2d1d559bb17489cacb9e20095f7171c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/98d0a56991de4053a2cd5cebbe597c6a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/81db5fd585914ac4b1e4478cb8381e24] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp, totalSize=25.4 K 2023-10-31 05:55:30,071 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 9042c22a33764643a5caeabd653ddbc3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731719542 2023-10-31 05:55:30,071 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting f8ae6541b2ed43e1b0497442b4864c39, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731721432 2023-10-31 05:55:30,072 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting e2d1d559bb17489cacb9e20095f7171c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731723348 2023-10-31 05:55:30,072 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 98d0a56991de4053a2cd5cebbe597c6a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731724854 2023-10-31 05:55:30,072 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 81db5fd585914ac4b1e4478cb8381e24, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:55:30,080 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): 17d7630b3bc4a54edc19d20d1c6d2e6b#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:55:30,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/a3aed570d44543c897faa449ea79eb9a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/9a484d9ef0d34949b3543413ed34e730, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/5aa6a16581cf47f99e6974352277b4a9, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/1d9da5cb88394143b5d2466a5dd98829, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/e275b046de0949fea2c1b3f742508e1e] to archive 2023-10-31 05:55:30,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:30,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/a3aed570d44543c897faa449ea79eb9a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/a3aed570d44543c897faa449ea79eb9a 2023-10-31 05:55:30,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/9a484d9ef0d34949b3543413ed34e730 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/9a484d9ef0d34949b3543413ed34e730 2023-10-31 05:55:30,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/5aa6a16581cf47f99e6974352277b4a9 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/5aa6a16581cf47f99e6974352277b4a9 2023-10-31 05:55:30,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/1d9da5cb88394143b5d2466a5dd98829 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/1d9da5cb88394143b5d2466a5dd98829 2023-10-31 05:55:30,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/e275b046de0949fea2c1b3f742508e1e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/e275b046de0949fea2c1b3f742508e1e 2023-10-31 05:55:30,488 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023103136463aca697a48a5b77ea08707636a65_del 2023-10-31 05:55:30,488 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103136463aca697a48a5b77ea08707636a65_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023103136463aca697a48a5b77ea08707636a65_del 2023-10-31 05:55:31,304 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d232d69200964b1db705409badfa9adb 2023-10-31 05:55:31,305 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/.tmp/family2/d232d69200964b1db705409badfa9adb as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/d232d69200964b1db705409badfa9adb 2023-10-31 05:55:31,309 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d232d69200964b1db705409badfa9adb 2023-10-31 05:55:31,309 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 17d7630b3bc4a54edc19d20d1c6d2e6b/family2 of 17d7630b3bc4a54edc19d20d1c6d2e6b into d232d69200964b1db705409badfa9adb(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:55:31,310 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:31,310 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:55:31,310 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): cd27d39a6a249e1e3a30c0f1ecf70690/family1 is initiating major compaction (all files) 2023-10-31 05:55:31,310 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:55:31,310 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:55:31,310 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of cd27d39a6a249e1e3a30c0f1ecf70690/family1 in testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:31,311 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/4a4c6887f82c4506a466bc4d42ae8d04, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/88a3f30361e542b5a055a363779ed5da, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/80534e103d6542398f0e394c93f28e77, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/14d3d51bbb7f4ab5a04fd91827ac50e0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/7b8ac819f5b44ce3a4cf49c3c58e4746] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp, totalSize=27.1 K 2023-10-31 05:55:31,311 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 4a4c6887f82c4506a466bc4d42ae8d04, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731719543 2023-10-31 05:55:31,311 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 88a3f30361e542b5a055a363779ed5da, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731721433 2023-10-31 05:55:31,312 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 80534e103d6542398f0e394c93f28e77, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731723348 2023-10-31 05:55:31,312 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 14d3d51bbb7f4ab5a04fd91827ac50e0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731724854 2023-10-31 05:55:31,312 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 7b8ac819f5b44ce3a4cf49c3c58e4746, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:55:31,320 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): cd27d39a6a249e1e3a30c0f1ecf70690#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:55:31,358 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310313ca8de2a11194c7db0f927e752144bd8_del 2023-10-31 05:55:31,358 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310313ca8de2a11194c7db0f927e752144bd8_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310313ca8de2a11194c7db0f927e752144bd8_del 2023-10-31 05:55:31,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/9042c22a33764643a5caeabd653ddbc3, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/f8ae6541b2ed43e1b0497442b4864c39, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/e2d1d559bb17489cacb9e20095f7171c, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/98d0a56991de4053a2cd5cebbe597c6a, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/81db5fd585914ac4b1e4478cb8381e24] to archive 2023-10-31 05:55:31,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:31,413 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/9042c22a33764643a5caeabd653ddbc3 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/9042c22a33764643a5caeabd653ddbc3 2023-10-31 05:55:31,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/f8ae6541b2ed43e1b0497442b4864c39 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/f8ae6541b2ed43e1b0497442b4864c39 2023-10-31 05:55:31,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/e2d1d559bb17489cacb9e20095f7171c to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/e2d1d559bb17489cacb9e20095f7171c 2023-10-31 05:55:31,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/98d0a56991de4053a2cd5cebbe597c6a to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/98d0a56991de4053a2cd5cebbe597c6a 2023-10-31 05:55:31,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/81db5fd585914ac4b1e4478cb8381e24 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family2/81db5fd585914ac4b1e4478cb8381e24 2023-10-31 05:55:32,211 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9889f5437814c0297eeda224adadff6 2023-10-31 05:55:32,211 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family1/d9889f5437814c0297eeda224adadff6 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/d9889f5437814c0297eeda224adadff6 2023-10-31 05:55:32,230 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9889f5437814c0297eeda224adadff6 2023-10-31 05:55:32,231 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cd27d39a6a249e1e3a30c0f1ecf70690/family1 of cd27d39a6a249e1e3a30c0f1ecf70690 into d9889f5437814c0297eeda224adadff6(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:55:32,231 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:32,231 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:55:32,232 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): cd27d39a6a249e1e3a30c0f1ecf70690/family2 is initiating major compaction (all files) 2023-10-31 05:55:32,232 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:55:32,232 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:55:32,233 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of cd27d39a6a249e1e3a30c0f1ecf70690/family2 in testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:32,233 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2898ca3a309f4cefa0e458dac424df21, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/8b5c54e6a0f541d6a912d72b5f0f515d, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/990b08272d654be0a6276365c3ae4c86, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2d626f515cb54c7685b746639d363aa2, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2b98b6aee6f94353a13af6ffc1ef82af] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp, totalSize=25.4 K 2023-10-31 05:55:32,233 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 2898ca3a309f4cefa0e458dac424df21, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731719543 2023-10-31 05:55:32,234 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 8b5c54e6a0f541d6a912d72b5f0f515d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731721433 2023-10-31 05:55:32,234 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 990b08272d654be0a6276365c3ae4c86, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731723348 2023-10-31 05:55:32,234 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 2d626f515cb54c7685b746639d363aa2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731724854 2023-10-31 05:55:32,234 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 2b98b6aee6f94353a13af6ffc1ef82af, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:55:32,241 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): cd27d39a6a249e1e3a30c0f1ecf70690#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:55:32,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/4a4c6887f82c4506a466bc4d42ae8d04, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/88a3f30361e542b5a055a363779ed5da, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/80534e103d6542398f0e394c93f28e77, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/14d3d51bbb7f4ab5a04fd91827ac50e0, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/7b8ac819f5b44ce3a4cf49c3c58e4746] to archive 2023-10-31 05:55:32,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:32,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/4a4c6887f82c4506a466bc4d42ae8d04 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/4a4c6887f82c4506a466bc4d42ae8d04 2023-10-31 05:55:32,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/88a3f30361e542b5a055a363779ed5da to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/88a3f30361e542b5a055a363779ed5da 2023-10-31 05:55:32,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/80534e103d6542398f0e394c93f28e77 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/80534e103d6542398f0e394c93f28e77 2023-10-31 05:55:32,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/14d3d51bbb7f4ab5a04fd91827ac50e0 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/14d3d51bbb7f4ab5a04fd91827ac50e0 2023-10-31 05:55:32,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/7b8ac819f5b44ce3a4cf49c3c58e4746 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/7b8ac819f5b44ce3a4cf49c3c58e4746 2023-10-31 05:55:32,648 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231031474ed181adb740b9923e81bea8958b7a_del 2023-10-31 05:55:32,648 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031474ed181adb740b9923e81bea8958b7a_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231031474ed181adb740b9923e81bea8958b7a_del 2023-10-31 05:55:33,462 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cd1d6cff8254b7e88167460ea244a73 2023-10-31 05:55:33,462 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/.tmp/family2/8cd1d6cff8254b7e88167460ea244a73 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/8cd1d6cff8254b7e88167460ea244a73 2023-10-31 05:55:33,465 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cd1d6cff8254b7e88167460ea244a73 2023-10-31 05:55:33,466 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cd27d39a6a249e1e3a30c0f1ecf70690/family2 of cd27d39a6a249e1e3a30c0f1ecf70690 into 8cd1d6cff8254b7e88167460ea244a73(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-31 05:55:33,466 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:33,466 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:55:33,466 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): 8205c24748dde14e74a6163cd9416e1f/family1 is initiating major compaction (all files) 2023-10-31 05:55:33,466 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:55:33,466 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:55:33,466 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of 8205c24748dde14e74a6163cd9416e1f/family1 in testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:33,467 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/1fd046d9bd294ff883227e7101787ff5, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/af8ff1017f854aeaa1d27c8e76f51101, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/10ae33f09786419da4b2caf24c623589, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/80c5c443d85c45d0976338ae940765d7, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/d43b393b311842ff8a4fb42ac6f1cd6b] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp, totalSize=27.1 K 2023-10-31 05:55:33,467 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 1fd046d9bd294ff883227e7101787ff5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731719543 2023-10-31 05:55:33,467 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting af8ff1017f854aeaa1d27c8e76f51101, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731721433 2023-10-31 05:55:33,468 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 10ae33f09786419da4b2caf24c623589, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731723348 2023-10-31 05:55:33,468 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 80c5c443d85c45d0976338ae940765d7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731724854 2023-10-31 05:55:33,468 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting d43b393b311842ff8a4fb42ac6f1cd6b, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:55:33,474 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): 8205c24748dde14e74a6163cd9416e1f#family1#compaction#201 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:55:33,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2898ca3a309f4cefa0e458dac424df21, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/8b5c54e6a0f541d6a912d72b5f0f515d, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/990b08272d654be0a6276365c3ae4c86, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2d626f515cb54c7685b746639d363aa2, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2b98b6aee6f94353a13af6ffc1ef82af] to archive 2023-10-31 05:55:33,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:33,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2898ca3a309f4cefa0e458dac424df21 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2898ca3a309f4cefa0e458dac424df21 2023-10-31 05:55:33,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/8b5c54e6a0f541d6a912d72b5f0f515d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/8b5c54e6a0f541d6a912d72b5f0f515d 2023-10-31 05:55:33,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/990b08272d654be0a6276365c3ae4c86 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/990b08272d654be0a6276365c3ae4c86 2023-10-31 05:55:33,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2d626f515cb54c7685b746639d363aa2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2d626f515cb54c7685b746639d363aa2 2023-10-31 05:55:33,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2b98b6aee6f94353a13af6ffc1ef82af to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family2/2b98b6aee6f94353a13af6ffc1ef82af 2023-10-31 05:55:33,905 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310310e5fab769354469296a02bd683ca230f_del 2023-10-31 05:55:33,905 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310310e5fab769354469296a02bd683ca230f_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310310e5fab769354469296a02bd683ca230f_del 2023-10-31 05:55:33,907 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-10-31 05:55:34,378 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1039e696b41a4ad285a46ff90b4aad51 2023-10-31 05:55:34,379 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family1/1039e696b41a4ad285a46ff90b4aad51 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/1039e696b41a4ad285a46ff90b4aad51 2023-10-31 05:55:34,405 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1039e696b41a4ad285a46ff90b4aad51 2023-10-31 05:55:34,406 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8205c24748dde14e74a6163cd9416e1f/family1 of 8205c24748dde14e74a6163cd9416e1f into 1039e696b41a4ad285a46ff90b4aad51(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:55:34,406 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:34,406 DEBUG [Listener at localhost/40291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-31 05:55:34,406 DEBUG [Listener at localhost/40291] regionserver.HStore(1912): 8205c24748dde14e74a6163cd9416e1f/family2 is initiating major compaction (all files) 2023-10-31 05:55:34,406 INFO [Listener at localhost/40291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-31 05:55:34,406 INFO [Listener at localhost/40291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-31 05:55:34,407 INFO [Listener at localhost/40291] regionserver.HRegion(2259): Starting compaction of 8205c24748dde14e74a6163cd9416e1f/family2 in testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:34,407 INFO [Listener at localhost/40291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/37e697bbc66c423da8ef48edab631233, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/277d89ba437d4243b24d2a2a8aa5c2c4, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/8ac3bf83485c4692ae709fd01a3eb8fa, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/c346cffec4d7437984deaff2b2a3f362, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/2e9ca5bd1656436a908335db3481dc70] into tmpdir=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp, totalSize=25.4 K 2023-10-31 05:55:34,407 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 37e697bbc66c423da8ef48edab631233, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698731719543 2023-10-31 05:55:34,408 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 277d89ba437d4243b24d2a2a8aa5c2c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698731721433 2023-10-31 05:55:34,408 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 8ac3bf83485c4692ae709fd01a3eb8fa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698731723348 2023-10-31 05:55:34,408 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting c346cffec4d7437984deaff2b2a3f362, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698731724854 2023-10-31 05:55:34,408 DEBUG [Listener at localhost/40291] compactions.Compactor(207): Compacting 2e9ca5bd1656436a908335db3481dc70, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-31 05:55:34,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/1fd046d9bd294ff883227e7101787ff5, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/af8ff1017f854aeaa1d27c8e76f51101, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/10ae33f09786419da4b2caf24c623589, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/80c5c443d85c45d0976338ae940765d7, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/d43b393b311842ff8a4fb42ac6f1cd6b] to archive 2023-10-31 05:55:34,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:34,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/1fd046d9bd294ff883227e7101787ff5 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/1fd046d9bd294ff883227e7101787ff5 2023-10-31 05:55:34,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/af8ff1017f854aeaa1d27c8e76f51101 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/af8ff1017f854aeaa1d27c8e76f51101 2023-10-31 05:55:34,415 INFO [Listener at localhost/40291] throttle.PressureAwareThroughputController(145): 8205c24748dde14e74a6163cd9416e1f#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-31 05:55:34,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/10ae33f09786419da4b2caf24c623589 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/10ae33f09786419da4b2caf24c623589 2023-10-31 05:55:34,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/80c5c443d85c45d0976338ae940765d7 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/80c5c443d85c45d0976338ae940765d7 2023-10-31 05:55:34,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/d43b393b311842ff8a4fb42ac6f1cd6b to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/d43b393b311842ff8a4fb42ac6f1cd6b 2023-10-31 05:55:34,428 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310313751dd2565744922b29f67ed1ad75c4d_del 2023-10-31 05:55:34,428 INFO [Listener at localhost/40291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310313751dd2565744922b29f67ed1ad75c4d_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310313751dd2565744922b29f67ed1ad75c4d_del 2023-10-31 05:55:35,173 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-10-31 05:55:35,245 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72f7a40ea1fb4a0fbff23718b90d41ae 2023-10-31 05:55:35,246 DEBUG [Listener at localhost/40291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/.tmp/family2/72f7a40ea1fb4a0fbff23718b90d41ae as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/72f7a40ea1fb4a0fbff23718b90d41ae 2023-10-31 05:55:35,249 INFO [Listener at localhost/40291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72f7a40ea1fb4a0fbff23718b90d41ae 2023-10-31 05:55:35,250 INFO [Listener at localhost/40291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8205c24748dde14e74a6163cd9416e1f/family2 of 8205c24748dde14e74a6163cd9416e1f into 72f7a40ea1fb4a0fbff23718b90d41ae(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-31 05:55:35,250 DEBUG [Listener at localhost/40291] regionserver.HRegion(2289): Compaction status journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:35,253 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:55:35,256 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:55:35,259 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:55:35,259 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:55:35,264 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42133] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC08\xC2F\x0E\xCC)\xE7\xF4\xE8PV&\xAC/\xAF"\x10\xE2\xF1\x99\xD1\xCD\x16;\xD51\x860c\xCF{\x10\xFC*\x10\xF84\x7F\xA2!p\xB5iA\x06zh\xBA\xFF8H2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-10-31 05:55:35,282 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-31 05:55:35,283 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-31 05:55:35,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:55:35,283 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698732335283 2023-10-31 05:55:35,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-31 05:55:35,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/37e697bbc66c423da8ef48edab631233, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/277d89ba437d4243b24d2a2a8aa5c2c4, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/8ac3bf83485c4692ae709fd01a3eb8fa, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/c346cffec4d7437984deaff2b2a3f362, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/2e9ca5bd1656436a908335db3481dc70] to archive 2023-10-31 05:55:35,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:35,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/37e697bbc66c423da8ef48edab631233 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/37e697bbc66c423da8ef48edab631233 2023-10-31 05:55:35,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/277d89ba437d4243b24d2a2a8aa5c2c4 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/277d89ba437d4243b24d2a2a8aa5c2c4 2023-10-31 05:55:35,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/8ac3bf83485c4692ae709fd01a3eb8fa to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/8ac3bf83485c4692ae709fd01a3eb8fa 2023-10-31 05:55:35,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/c346cffec4d7437984deaff2b2a3f362 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/c346cffec4d7437984deaff2b2a3f362 2023-10-31 05:55:35,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/2e9ca5bd1656436a908335db3481dc70 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family2/2e9ca5bd1656436a908335db3481dc70 2023-10-31 05:55:35,604 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-10-31 05:55:35,624 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310314bd3a27da53042fa8782a59a2420ebb0_del 2023-10-31 05:55:35,653 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310310e5fab769354469296a02bd683ca230f_del 2023-10-31 05:55:35,672 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310313ca8de2a11194c7db0f927e752144bd8_del 2023-10-31 05:55:35,673 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-31 05:55:35,673 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] zookeeper.ReadOnlyZKClient(139): Connect 0x5719c341 to 127.0.0.1:64652 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-31 05:55:35,678 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17b68a01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-31 05:55:35,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231031 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-31 05:55:35,824 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103177a7b626c4334cfda218e4ae5c7c3bee to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103177a7b626c4334cfda218e4ae5c7c3bee 2023-10-31 05:55:35,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231031 table='testMajorCompactionFromAdmin' column='family1' 2023-10-31 05:55:35,835 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-31 05:55:35,837 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-31 05:55:35,842 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-31 05:55:35,844 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-31 05:55:35,869 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231031/family1/8a3c57f8d2a44f37b17dee0d54145f6f first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-31 05:55:35,870 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231031/family1/8a3c57f8d2a44f37b17dee0d54145f6f}] 2023-10-31 05:55:35,874 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231031/family1/8a3c57f8d2a44f37b17dee0d54145f6f for inclusion in 8205c24748dde14e74a6163cd9416e1f/family1 2023-10-31 05:55:35,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-31 05:55:35,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-31 05:55:35,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:35,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231031/family1/8a3c57f8d2a44f37b17dee0d54145f6f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__5hge6i77ku88dnrh2ckknikb5cm83a9i008jk6k9kuq8n3pha6f1du9hf595vnt8/family1/8a3c57f8d2a44f37b17dee0d54145f6f 2023-10-31 05:55:35,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__5hge6i77ku88dnrh2ckknikb5cm83a9i008jk6k9kuq8n3pha6f1du9hf595vnt8/family1/8a3c57f8d2a44f37b17dee0d54145f6f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/787d9c7010ef49c7916e179e977c8cc0_SeqId_28_ 2023-10-31 05:55:35,905 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__5hge6i77ku88dnrh2ckknikb5cm83a9i008jk6k9kuq8n3pha6f1du9hf595vnt8/family1/8a3c57f8d2a44f37b17dee0d54145f6f into 8205c24748dde14e74a6163cd9416e1f/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/787d9c7010ef49c7916e179e977c8cc0_SeqId_28_ - updating store file list. 2023-10-31 05:55:35,931 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/787d9c7010ef49c7916e179e977c8cc0_SeqId_28_ into 8205c24748dde14e74a6163cd9416e1f/family1 2023-10-31 05:55:35,931 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__5hge6i77ku88dnrh2ckknikb5cm83a9i008jk6k9kuq8n3pha6f1du9hf595vnt8/family1/8a3c57f8d2a44f37b17dee0d54145f6f into 8205c24748dde14e74a6163cd9416e1f/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/family1/787d9c7010ef49c7916e179e977c8cc0_SeqId_28_) 2023-10-31 05:55:35,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__5hge6i77ku88dnrh2ckknikb5cm83a9i008jk6k9kuq8n3pha6f1du9hf595vnt8/family1/8a3c57f8d2a44f37b17dee0d54145f6f 2023-10-31 05:55:35,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231031 table='testMajorCompactionFromAdmin' column='family1' 2023-10-31 05:55:35,934 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:35,936 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310310bd1ab33f4264c78ba8cbb0f7223263e to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310310bd1ab33f4264c78ba8cbb0f7223263e 2023-10-31 05:55:35,937 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103151f153f6ad7c4eee84956270ef4d0ecf to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103151f153f6ad7c4eee84956270ef4d0ecf 2023-10-31 05:55:35,938 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103172f3f5849bf34f96a475c819c95e08da to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103172f3f5849bf34f96a475c819c95e08da 2023-10-31 05:55:35,939 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231031f57d53285f984c8cac381d7050c3e999 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231031f57d53285f984c8cac381d7050c3e999 2023-10-31 05:55:35,939 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-31 05:55:35,939 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231031' 2023-10-31 05:55:35,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231031 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-31 05:55:35,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231031 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-31 05:55:36,888 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231031c71551a3798b498dbe2985c5c1942eaa to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231031c71551a3798b498dbe2985c5c1942eaa 2023-10-31 05:55:36,888 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231031 table='testMajorCompactionFromAdmin' column='family1' 2023-10-31 05:55:36,927 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231031/family1/9cc6b786f8f042eea7a8397f0c5095b6 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-31 05:55:36,928 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231031/family1/9cc6b786f8f042eea7a8397f0c5095b6}] 2023-10-31 05:55:36,929 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231031/family1/9cc6b786f8f042eea7a8397f0c5095b6 for inclusion in cd27d39a6a249e1e3a30c0f1ecf70690/family1 2023-10-31 05:55:36,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-31 05:55:36,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-31 05:55:36,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:36,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231031/family1/9cc6b786f8f042eea7a8397f0c5095b6 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__ngg7gjd7nev9i8toqssvgm4ukdp6ad4mrlum3808v53r5us75jd0vhlqvid9h52p/family1/9cc6b786f8f042eea7a8397f0c5095b6 2023-10-31 05:55:36,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__ngg7gjd7nev9i8toqssvgm4ukdp6ad4mrlum3808v53r5us75jd0vhlqvid9h52p/family1/9cc6b786f8f042eea7a8397f0c5095b6 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/2e7caf298d1c42aa8620c134d71a0602_SeqId_28_ 2023-10-31 05:55:36,954 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__ngg7gjd7nev9i8toqssvgm4ukdp6ad4mrlum3808v53r5us75jd0vhlqvid9h52p/family1/9cc6b786f8f042eea7a8397f0c5095b6 into cd27d39a6a249e1e3a30c0f1ecf70690/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/2e7caf298d1c42aa8620c134d71a0602_SeqId_28_ - updating store file list. 2023-10-31 05:55:36,975 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/2e7caf298d1c42aa8620c134d71a0602_SeqId_28_ into cd27d39a6a249e1e3a30c0f1ecf70690/family1 2023-10-31 05:55:36,975 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__ngg7gjd7nev9i8toqssvgm4ukdp6ad4mrlum3808v53r5us75jd0vhlqvid9h52p/family1/9cc6b786f8f042eea7a8397f0c5095b6 into cd27d39a6a249e1e3a30c0f1ecf70690/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/family1/2e7caf298d1c42aa8620c134d71a0602_SeqId_28_) 2023-10-31 05:55:36,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__ngg7gjd7nev9i8toqssvgm4ukdp6ad4mrlum3808v53r5us75jd0vhlqvid9h52p/family1/9cc6b786f8f042eea7a8397f0c5095b6 2023-10-31 05:55:36,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231031 table='testMajorCompactionFromAdmin' column='family1' 2023-10-31 05:55:36,978 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:36,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103175b4fa6045eb4c75b4f34f2ec0480859 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103175b4fa6045eb4c75b4f34f2ec0480859 2023-10-31 05:55:36,980 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231031808cfb1282104597b1fe3429e1edc18d to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231031808cfb1282104597b1fe3429e1edc18d 2023-10-31 05:55:36,981 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231031f16b2880b66e44948f3e56df36777bac to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231031f16b2880b66e44948f3e56df36777bac 2023-10-31 05:55:36,982 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231031f6dbb527ea884b9a8f45cbbec9217040 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231031f6dbb527ea884b9a8f45cbbec9217040 2023-10-31 05:55:36,982 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-31 05:55:36,982 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231031' 2023-10-31 05:55:36,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231031 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-31 05:55:36,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231031 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-31 05:55:37,915 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103106d5151b58164beab90fd0a13b8d02e8 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103106d5151b58164beab90fd0a13b8d02e8 2023-10-31 05:55:37,916 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231031 table='testMajorCompactionFromAdmin' column='family1' 2023-10-31 05:55:37,959 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231031/family1/3c69b3bcee2644d1a6cd04f18d782f44 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-31 05:55:37,960 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b., hostname=jenkins-hbase20.apache.org,43723,1698731565849, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231031/family1/3c69b3bcee2644d1a6cd04f18d782f44}] 2023-10-31 05:55:37,962 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(763): Validating hfile at hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231031/family1/3c69b3bcee2644d1a6cd04f18d782f44 for inclusion in 17d7630b3bc4a54edc19d20d1c6d2e6b/family1 2023-10-31 05:55:37,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-31 05:55:37,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(777): Region bounds: first= last=1 2023-10-31 05:55:37,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegion(2446): Flush status journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:37,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231031/family1/3c69b3bcee2644d1a6cd04f18d782f44 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__sl741pu3t1fv9ovom8oo6208e0ngc7uqo0elsh0e6bvkdm4f6v03pfet72rlmm40/family1/3c69b3bcee2644d1a6cd04f18d782f44 2023-10-31 05:55:37,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__sl741pu3t1fv9ovom8oo6208e0ngc7uqo0elsh0e6bvkdm4f6v03pfet72rlmm40/family1/3c69b3bcee2644d1a6cd04f18d782f44 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/c9954d89dc6241a48f02a3b77975756b_SeqId_28_ 2023-10-31 05:55:37,983 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(849): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__sl741pu3t1fv9ovom8oo6208e0ngc7uqo0elsh0e6bvkdm4f6v03pfet72rlmm40/family1/3c69b3bcee2644d1a6cd04f18d782f44 into 17d7630b3bc4a54edc19d20d1c6d2e6b/family1 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/c9954d89dc6241a48f02a3b77975756b_SeqId_28_ - updating store file list. 2023-10-31 05:55:38,002 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(882): Loaded HFile hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/c9954d89dc6241a48f02a3b77975756b_SeqId_28_ into 17d7630b3bc4a54edc19d20d1c6d2e6b/family1 2023-10-31 05:55:38,002 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.HStore(855): Successfully loaded hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__sl741pu3t1fv9ovom8oo6208e0ngc7uqo0elsh0e6bvkdm4f6v03pfet72rlmm40/family1/3c69b3bcee2644d1a6cd04f18d782f44 into 17d7630b3bc4a54edc19d20d1c6d2e6b/family1 (new location: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/family1/c9954d89dc6241a48f02a3b77975756b_SeqId_28_) 2023-10-31 05:55:38,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43723] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/staging/jenkins__testMajorCompactionFromAdmin__sl741pu3t1fv9ovom8oo6208e0ngc7uqo0elsh0e6bvkdm4f6v03pfet72rlmm40/family1/3c69b3bcee2644d1a6cd04f18d782f44 2023-10-31 05:55:38,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231031 table='testMajorCompactionFromAdmin' column='family1' 2023-10-31 05:55:38,005 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:38,006 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310311acb488c02b541458e463317713a508f to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310311acb488c02b541458e463317713a508f 2023-10-31 05:55:38,007 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103156c4d89d184a46c192b6adca124826c2 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103156c4d89d184a46c192b6adca124826c2 2023-10-31 05:55:38,007 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231031977ecd46d22d4c449744c11dfdb0d7fb to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231031977ecd46d22d4c449744c11dfdb0d7fb 2023-10-31 05:55:38,008 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231031b45e2619e25e425eb05628fe62db1338 to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231031b45e2619e25e425eb05628fe62db1338 2023-10-31 05:55:38,008 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-31 05:55:38,008 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231031' 2023-10-31 05:55:38,008 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231031 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-31 05:55:38,008 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-31 05:55:38,008 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-31 05:55:38,008 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310314bd3a27da53042fa8782a59a2420ebb0_del] 2023-10-31 05:55:38,009 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:38,010 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310314bd3a27da53042fa8782a59a2420ebb0_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310314bd3a27da53042fa8782a59a2420ebb0_del 2023-10-31 05:55:38,010 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-31 05:55:38,010 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310310e5fab769354469296a02bd683ca230f_del] 2023-10-31 05:55:38,010 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:38,011 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310310e5fab769354469296a02bd683ca230f_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310310e5fab769354469296a02bd683ca230f_del 2023-10-31 05:55:38,011 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-31 05:55:38,011 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310313ca8de2a11194c7db0f927e752144bd8_del] 2023-10-31 05:55:38,011 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] backup.HFileArchiver(360): Archiving compacted files. 2023-10-31 05:55:38,012 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310313ca8de2a11194c7db0f927e752144bd8_del to hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310313ca8de2a11194c7db0f927e752144bd8_del 2023-10-31 05:55:38,012 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-31 05:55:38,012 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698731568875] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-31 05:55:38,013 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-31 05:55:38,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.7320 sec 2023-10-31 05:55:38,036 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:55:38,038 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:55:38,041 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-31 05:55:38,041 DEBUG [Listener at localhost/40291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-31 05:55:38,046 INFO [Listener at localhost/40291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-31 05:55:38,080 INFO [Listener at localhost/40291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 254), OpenFileDescriptor=638 (was 646), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=199 (was 125) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 169), AvailableMemoryMB=1832 (was 2220) 2023-10-31 05:55:38,081 DEBUG [Listener at localhost/40291] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4829393b to 127.0.0.1:64652 2023-10-31 05:55:38,081 DEBUG [Listener at localhost/40291] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:55:38,082 INFO [Listener at localhost/40291] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-31 05:55:38,082 INFO [Listener at localhost/40291] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-31 05:55:38,082 DEBUG [Listener at localhost/40291] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07641ea7 to 127.0.0.1:64652 2023-10-31 05:55:38,082 DEBUG [Listener at localhost/40291] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:55:38,082 DEBUG [Listener at localhost/40291] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-31 05:55:38,082 DEBUG [Listener at localhost/40291] util.JVMClusterUtil(257): Found active master hash=1047560458, stopped=false 2023-10-31 05:55:38,082 INFO [Listener at localhost/40291] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase20.apache.org,42133,1698731564798 2023-10-31 05:55:38,083 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-31 05:55:38,083 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-31 05:55:38,083 INFO [Listener at localhost/40291] procedure2.ProcedureExecutor(628): Stopping 2023-10-31 05:55:38,083 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-31 05:55:38,083 DEBUG [Listener at localhost/40291] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x680e8dd5 to 127.0.0.1:64652 2023-10-31 05:55:38,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-31 05:55:38,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-31 05:55:38,083 DEBUG [Listener at localhost/40291] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:55:38,083 INFO [Listener at localhost/40291] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,43723,1698731565849' ***** 2023-10-31 05:55:38,083 INFO [Listener at localhost/40291] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-31 05:55:38,083 INFO [RS:0;jenkins-hbase20:43723] regionserver.HeapMemoryManager(220): Stopping 2023-10-31 05:55:38,084 INFO [RS:0;jenkins-hbase20:43723] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-31 05:55:38,084 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-31 05:55:38,084 INFO [RS:0;jenkins-hbase20:43723] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-31 05:55:38,084 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 17d7630b3bc4a54edc19d20d1c6d2e6b 2023-10-31 05:55:38,084 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 8d6401043828af0dc71fdb666c576f99 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 87e435865246ef33e92819389f9c177c 2023-10-31 05:55:38,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 17d7630b3bc4a54edc19d20d1c6d2e6b, disabling compactions & flushes 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for e848040dfe4476a52f6685d5355a71be 2023-10-31 05:55:38,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for cea181bfa49537540d492f4100b9b7eb 2023-10-31 05:55:38,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:55:38,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. after waiting 0 ms 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 7e09392ae4cf8022f3e80e0b0d3a1885 2023-10-31 05:55:38,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 34d5b8c551c956a0733f9187888bd6e0 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for eaf0660ca2db156b91cead03709332e6 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 405bdcc0cafe6c5fe7e0825a7b7c50cf 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for b7e12c6f039ff414ef8eee79c79535bf 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for cd27d39a6a249e1e3a30c0f1ecf70690 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 72f3bdf4e34390e87c32328650f148d0 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for f0080370107a624806071940a49aebd1 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for c6b985ab7f7859b84143c402f7db58c5 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for b6985a2cc2919965fb7596a8d6d5d3b2 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 628a5257bb9f5cc770f368f79a62df29 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 809ec7d82e56357140163c2d715145ac 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 8205c24748dde14e74a6163cd9416e1f 2023-10-31 05:55:38,085 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:38,085 DEBUG [RS:0;jenkins-hbase20:43723] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63d9fff3 to 127.0.0.1:64652 2023-10-31 05:55:38,085 DEBUG [RS:0;jenkins-hbase20:43723] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:55:38,086 INFO [RS:0;jenkins-hbase20:43723] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-31 05:55:38,086 INFO [RS:0;jenkins-hbase20:43723] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-31 05:55:38,086 INFO [RS:0;jenkins-hbase20:43723] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-31 05:55:38,086 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-31 05:55:38,086 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-10-31 05:55:38,086 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-31 05:55:38,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-31 05:55:38,086 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-31 05:55:38,086 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-31 05:55:38,086 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-31 05:55:38,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-10-31 05:55:38,087 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1504): Waiting on 1588230740, 17d7630b3bc4a54edc19d20d1c6d2e6b, 34d5b8c551c956a0733f9187888bd6e0, 405bdcc0cafe6c5fe7e0825a7b7c50cf, 628a5257bb9f5cc770f368f79a62df29, 72f3bdf4e34390e87c32328650f148d0, 7e09392ae4cf8022f3e80e0b0d3a1885, 809ec7d82e56357140163c2d715145ac, 8205c24748dde14e74a6163cd9416e1f, 87e435865246ef33e92819389f9c177c, 8d6401043828af0dc71fdb666c576f99, b6985a2cc2919965fb7596a8d6d5d3b2, b7e12c6f039ff414ef8eee79c79535bf, c6b985ab7f7859b84143c402f7db58c5, cd27d39a6a249e1e3a30c0f1ecf70690, cea181bfa49537540d492f4100b9b7eb, e848040dfe4476a52f6685d5355a71be, eaf0660ca2db156b91cead03709332e6, eb42a9600adc7511b8ec2d129b0a1882, f0080370107a624806071940a49aebd1, f22d093a048d2c7989ada8d66d0a76fb 2023-10-31 05:55:38,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/17d7630b3bc4a54edc19d20d1c6d2e6b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-31 05:55:38,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:38,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 17d7630b3bc4a54edc19d20d1c6d2e6b: 2023-10-31 05:55:38,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1698731717381.17d7630b3bc4a54edc19d20d1c6d2e6b. 2023-10-31 05:55:38,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8d6401043828af0dc71fdb666c576f99, disabling compactions & flushes 2023-10-31 05:55:38,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:55:38,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:55:38,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. after waiting 0 ms 2023-10-31 05:55:38,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:55:38,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/8d6401043828af0dc71fdb666c576f99/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-31 05:55:38,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:55:38,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8d6401043828af0dc71fdb666c576f99: 2023-10-31 05:55:38,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1698731687204.8d6401043828af0dc71fdb666c576f99. 2023-10-31 05:55:38,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 87e435865246ef33e92819389f9c177c, disabling compactions & flushes 2023-10-31 05:55:38,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:55:38,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:55:38,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. after waiting 0 ms 2023-10-31 05:55:38,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:55:38,103 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-10-31 05:55:38,104 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-31 05:55:38,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/87e435865246ef33e92819389f9c177c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-31 05:55:38,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:55:38,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 87e435865246ef33e92819389f9c177c: 2023-10-31 05:55:38,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1698731687204.87e435865246ef33e92819389f9c177c. 2023-10-31 05:55:38,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e848040dfe4476a52f6685d5355a71be, disabling compactions & flushes 2023-10-31 05:55:38,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:55:38,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:55:38,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. after waiting 0 ms 2023-10-31 05:55:38,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:55:38,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e848040dfe4476a52f6685d5355a71be/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-31 05:55:38,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:55:38,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e848040dfe4476a52f6685d5355a71be: 2023-10-31 05:55:38,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698731569013.e848040dfe4476a52f6685d5355a71be. 2023-10-31 05:55:38,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cea181bfa49537540d492f4100b9b7eb, disabling compactions & flushes 2023-10-31 05:55:38,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:55:38,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:55:38,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. after waiting 0 ms 2023-10-31 05:55:38,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:55:38,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/cea181bfa49537540d492f4100b9b7eb/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-31 05:55:38,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:55:38,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cea181bfa49537540d492f4100b9b7eb: 2023-10-31 05:55:38,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1698731608563.cea181bfa49537540d492f4100b9b7eb. 2023-10-31 05:55:38,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f22d093a048d2c7989ada8d66d0a76fb, disabling compactions & flushes 2023-10-31 05:55:38,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:55:38,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:55:38,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. after waiting 0 ms 2023-10-31 05:55:38,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:55:38,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/f22d093a048d2c7989ada8d66d0a76fb/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-31 05:55:38,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:55:38,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f22d093a048d2c7989ada8d66d0a76fb: 2023-10-31 05:55:38,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1698731661234.f22d093a048d2c7989ada8d66d0a76fb. 2023-10-31 05:55:38,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7e09392ae4cf8022f3e80e0b0d3a1885, disabling compactions & flushes 2023-10-31 05:55:38,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:55:38,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:55:38,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. after waiting 0 ms 2023-10-31 05:55:38,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:55:38,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/ns/testMinorCompaction/7e09392ae4cf8022f3e80e0b0d3a1885/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-31 05:55:38,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:55:38,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7e09392ae4cf8022f3e80e0b0d3a1885: 2023-10-31 05:55:38,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1698731687204.7e09392ae4cf8022f3e80e0b0d3a1885. 2023-10-31 05:55:38,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 34d5b8c551c956a0733f9187888bd6e0, disabling compactions & flushes 2023-10-31 05:55:38,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:55:38,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:55:38,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. after waiting 0 ms 2023-10-31 05:55:38,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:55:38,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/34d5b8c551c956a0733f9187888bd6e0/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-31 05:55:38,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:55:38,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 34d5b8c551c956a0733f9187888bd6e0: 2023-10-31 05:55:38,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1698731608563.34d5b8c551c956a0733f9187888bd6e0. 2023-10-31 05:55:38,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing eaf0660ca2db156b91cead03709332e6, disabling compactions & flushes 2023-10-31 05:55:38,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:55:38,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:55:38,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. after waiting 0 ms 2023-10-31 05:55:38,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:55:38,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyPolicy/eaf0660ca2db156b91cead03709332e6/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-10-31 05:55:38,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:55:38,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for eaf0660ca2db156b91cead03709332e6: 2023-10-31 05:55:38,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1698731612252.eaf0660ca2db156b91cead03709332e6. 2023-10-31 05:55:38,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 405bdcc0cafe6c5fe7e0825a7b7c50cf, disabling compactions & flushes 2023-10-31 05:55:38,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:55:38,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:55:38,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. after waiting 0 ms 2023-10-31 05:55:38,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:55:38,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/405bdcc0cafe6c5fe7e0825a7b7c50cf/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-31 05:55:38,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:55:38,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 405bdcc0cafe6c5fe7e0825a7b7c50cf: 2023-10-31 05:55:38,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698731638797.405bdcc0cafe6c5fe7e0825a7b7c50cf. 2023-10-31 05:55:38,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b7e12c6f039ff414ef8eee79c79535bf, disabling compactions & flushes 2023-10-31 05:55:38,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:55:38,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:55:38,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. after waiting 0 ms 2023-10-31 05:55:38,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:55:38,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/b7e12c6f039ff414ef8eee79c79535bf/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-31 05:55:38,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:55:38,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b7e12c6f039ff414ef8eee79c79535bf: 2023-10-31 05:55:38,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1698731661234.b7e12c6f039ff414ef8eee79c79535bf. 2023-10-31 05:55:38,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cd27d39a6a249e1e3a30c0f1ecf70690, disabling compactions & flushes 2023-10-31 05:55:38,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:38,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:38,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. after waiting 0 ms 2023-10-31 05:55:38,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:38,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/cd27d39a6a249e1e3a30c0f1ecf70690/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-31 05:55:38,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:38,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cd27d39a6a249e1e3a30c0f1ecf70690: 2023-10-31 05:55:38,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1698731717381.cd27d39a6a249e1e3a30c0f1ecf70690. 2023-10-31 05:55:38,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 72f3bdf4e34390e87c32328650f148d0, disabling compactions & flushes 2023-10-31 05:55:38,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:55:38,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:55:38,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. after waiting 0 ms 2023-10-31 05:55:38,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:55:38,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithMonthlyPolicy/72f3bdf4e34390e87c32328650f148d0/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-31 05:55:38,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:55:38,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 72f3bdf4e34390e87c32328650f148d0: 2023-10-31 05:55:38,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1698731580744.72f3bdf4e34390e87c32328650f148d0. 2023-10-31 05:55:38,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f0080370107a624806071940a49aebd1, disabling compactions & flushes 2023-10-31 05:55:38,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:55:38,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:55:38,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. after waiting 0 ms 2023-10-31 05:55:38,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:55:38,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f0080370107a624806071940a49aebd1/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-31 05:55:38,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:55:38,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f0080370107a624806071940a49aebd1: 2023-10-31 05:55:38,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698731623565.f0080370107a624806071940a49aebd1. 2023-10-31 05:55:38,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c6b985ab7f7859b84143c402f7db58c5, disabling compactions & flushes 2023-10-31 05:55:38,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:55:38,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:55:38,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. after waiting 0 ms 2023-10-31 05:55:38,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:55:38,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing c6b985ab7f7859b84143c402f7db58c5 1/1 column families, dataSize=109 B heapSize=592 B 2023-10-31 05:55:38,287 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1504): Waiting on 1588230740, 628a5257bb9f5cc770f368f79a62df29, 809ec7d82e56357140163c2d715145ac, 8205c24748dde14e74a6163cd9416e1f, b6985a2cc2919965fb7596a8d6d5d3b2, c6b985ab7f7859b84143c402f7db58c5, eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:55:38,487 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1504): Waiting on 1588230740, 628a5257bb9f5cc770f368f79a62df29, 809ec7d82e56357140163c2d715145ac, 8205c24748dde14e74a6163cd9416e1f, b6985a2cc2919965fb7596a8d6d5d3b2, c6b985ab7f7859b84143c402f7db58c5, eb42a9600adc7511b8ec2d129b0a1882 2023-10-31 05:55:38,501 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/.tmp/info/df06847b9cb04e10a2d01625d71df1db 2023-10-31 05:55:38,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df06847b9cb04e10a2d01625d71df1db 2023-10-31 05:55:38,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5/.tmp/info/38c0a249453346628d08ef46e5e38615 2023-10-31 05:55:38,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5/.tmp/info/38c0a249453346628d08ef46e5e38615 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5/info/38c0a249453346628d08ef46e5e38615 2023-10-31 05:55:38,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5/info/38c0a249453346628d08ef46e5e38615, entries=3, sequenceid=7, filesize=4.8 K 2023-10-31 05:55:38,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for c6b985ab7f7859b84143c402f7db58c5 in 414ms, sequenceid=7, compaction requested=false 2023-10-31 05:55:38,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/namespace/c6b985ab7f7859b84143c402f7db58c5/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-10-31 05:55:38,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:55:38,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c6b985ab7f7859b84143c402f7db58c5: 2023-10-31 05:55:38,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1698731568152.c6b985ab7f7859b84143c402f7db58c5. 2023-10-31 05:55:38,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b6985a2cc2919965fb7596a8d6d5d3b2, disabling compactions & flushes 2023-10-31 05:55:38,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:55:38,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:55:38,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. after waiting 0 ms 2023-10-31 05:55:38,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:55:38,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testScannerOnBulkLoadRefHFiles/b6985a2cc2919965fb7596a8d6d5d3b2/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-31 05:55:38,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:55:38,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b6985a2cc2919965fb7596a8d6d5d3b2: 2023-10-31 05:55:38,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1698731608563.b6985a2cc2919965fb7596a8d6d5d3b2. 2023-10-31 05:55:38,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 628a5257bb9f5cc770f368f79a62df29, disabling compactions & flushes 2023-10-31 05:55:38,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:55:38,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:55:38,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. after waiting 0 ms 2023-10-31 05:55:38,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:55:38,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithWeeklyPolicy/628a5257bb9f5cc770f368f79a62df29/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-31 05:55:38,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:55:38,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 628a5257bb9f5cc770f368f79a62df29: 2023-10-31 05:55:38,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1698731594960.628a5257bb9f5cc770f368f79a62df29. 2023-10-31 05:55:38,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing eb42a9600adc7511b8ec2d129b0a1882, disabling compactions & flushes 2023-10-31 05:55:38,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:55:38,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:55:38,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. after waiting 0 ms 2023-10-31 05:55:38,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:55:38,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testCompactionWithHFileLink/eb42a9600adc7511b8ec2d129b0a1882/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-31 05:55:38,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:55:38,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for eb42a9600adc7511b8ec2d129b0a1882: 2023-10-31 05:55:38,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1698731661234.eb42a9600adc7511b8ec2d129b0a1882. 2023-10-31 05:55:38,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 809ec7d82e56357140163c2d715145ac, disabling compactions & flushes 2023-10-31 05:55:38,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:38,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:38,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. after waiting 0 ms 2023-10-31 05:55:38,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:38,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMinorCompactionWithMonthlyPolicy/809ec7d82e56357140163c2d715145ac/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-31 05:55:38,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:38,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 809ec7d82e56357140163c2d715145ac: 2023-10-31 05:55:38,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1698731703266.809ec7d82e56357140163c2d715145ac. 2023-10-31 05:55:38,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8205c24748dde14e74a6163cd9416e1f, disabling compactions & flushes 2023-10-31 05:55:38,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:38,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:38,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. after waiting 0 ms 2023-10-31 05:55:38,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:38,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/default/testMajorCompactionFromAdmin/8205c24748dde14e74a6163cd9416e1f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-31 05:55:38,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:38,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8205c24748dde14e74a6163cd9416e1f: 2023-10-31 05:55:38,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1698731717381.8205c24748dde14e74a6163cd9416e1f. 2023-10-31 05:55:38,597 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-31 05:55:38,597 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-31 05:55:38,688 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-31 05:55:38,888 DEBUG [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-31 05:55:38,912 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/.tmp/rep_barrier/de0b02b3d6d84f018a87c7470ec71a27 2023-10-31 05:55:38,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de0b02b3d6d84f018a87c7470ec71a27 2023-10-31 05:55:38,929 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/.tmp/table/970529e70248495395606946d26a0840 2023-10-31 05:55:38,932 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 970529e70248495395606946d26a0840 2023-10-31 05:55:38,934 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/.tmp/info/df06847b9cb04e10a2d01625d71df1db as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/info/df06847b9cb04e10a2d01625d71df1db 2023-10-31 05:55:38,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df06847b9cb04e10a2d01625d71df1db 2023-10-31 05:55:38,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/info/df06847b9cb04e10a2d01625d71df1db, entries=226, sequenceid=130, filesize=37.9 K 2023-10-31 05:55:38,939 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/.tmp/rep_barrier/de0b02b3d6d84f018a87c7470ec71a27 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/rep_barrier/de0b02b3d6d84f018a87c7470ec71a27 2023-10-31 05:55:38,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de0b02b3d6d84f018a87c7470ec71a27 2023-10-31 05:55:38,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/rep_barrier/de0b02b3d6d84f018a87c7470ec71a27, entries=1, sequenceid=130, filesize=5.0 K 2023-10-31 05:55:38,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/.tmp/table/970529e70248495395606946d26a0840 as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/table/970529e70248495395606946d26a0840 2023-10-31 05:55:38,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 970529e70248495395606946d26a0840 2023-10-31 05:55:38,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/table/970529e70248495395606946d26a0840, entries=27, sequenceid=130, filesize=6.6 K 2023-10-31 05:55:38,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 870ms, sequenceid=130, compaction requested=false 2023-10-31 05:55:38,960 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-10-31 05:55:38,960 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-31 05:55:38,960 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-31 05:55:38,960 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-31 05:55:38,960 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-31 05:55:39,088 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,43723,1698731565849; all regions closed. 2023-10-31 05:55:39,101 DEBUG [RS:0;jenkins-hbase20:43723] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/oldWALs 2023-10-31 05:55:39,101 INFO [RS:0;jenkins-hbase20:43723] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43723%2C1698731565849.meta:.meta(num 1698731567893) 2023-10-31 05:55:39,107 DEBUG [RS:0;jenkins-hbase20:43723] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/oldWALs 2023-10-31 05:55:39,107 INFO [RS:0;jenkins-hbase20:43723] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43723%2C1698731565849:(num 1698731567749) 2023-10-31 05:55:39,107 DEBUG [RS:0;jenkins-hbase20:43723] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:55:39,107 INFO [RS:0;jenkins-hbase20:43723] regionserver.LeaseManager(133): Closed leases 2023-10-31 05:55:39,107 INFO [RS:0;jenkins-hbase20:43723] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-31 05:55:39,107 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-31 05:55:39,108 INFO [RS:0;jenkins-hbase20:43723] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43723 2023-10-31 05:55:39,116 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-31 05:55:39,116 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43723,1698731565849 2023-10-31 05:55:39,117 ERROR [Listener at localhost/40291-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44f10fef rejected from java.util.concurrent.ThreadPoolExecutor@40ce93a9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-10-31 05:55:39,117 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-31 05:55:39,117 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,43723,1698731565849] 2023-10-31 05:55:39,118 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,43723,1698731565849; numProcessing=1 2023-10-31 05:55:39,119 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,43723,1698731565849 already deleted, retry=false 2023-10-31 05:55:39,119 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase20.apache.org,43723,1698731565849 expired; onlineServers=0 2023-10-31 05:55:39,119 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,42133,1698731564798' ***** 2023-10-31 05:55:39,119 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-31 05:55:39,119 DEBUG [M:0;jenkins-hbase20:42133] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f4d8b31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-31 05:55:39,119 INFO [M:0;jenkins-hbase20:42133] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,42133,1698731564798 2023-10-31 05:55:39,119 INFO [M:0;jenkins-hbase20:42133] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,42133,1698731564798; all regions closed. 2023-10-31 05:55:39,119 DEBUG [M:0;jenkins-hbase20:42133] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-31 05:55:39,119 DEBUG [M:0;jenkins-hbase20:42133] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-31 05:55:39,120 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-31 05:55:39,120 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698731567390] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698731567390,5,FailOnTimeoutGroup] 2023-10-31 05:55:39,120 DEBUG [M:0;jenkins-hbase20:42133] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-31 05:55:39,120 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698731567389] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698731567389,5,FailOnTimeoutGroup] 2023-10-31 05:55:39,120 INFO [M:0;jenkins-hbase20:42133] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-31 05:55:39,120 INFO [M:0;jenkins-hbase20:42133] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-31 05:55:39,120 INFO [M:0;jenkins-hbase20:42133] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-10-31 05:55:39,121 DEBUG [M:0;jenkins-hbase20:42133] master.HMaster(1512): Stopping service threads 2023-10-31 05:55:39,121 INFO [M:0;jenkins-hbase20:42133] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-31 05:55:39,121 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-31 05:55:39,121 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-31 05:55:39,121 ERROR [M:0;jenkins-hbase20:42133] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-10-31 05:55:39,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-31 05:55:39,122 INFO [M:0;jenkins-hbase20:42133] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-31 05:55:39,122 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-31 05:55:39,122 DEBUG [M:0;jenkins-hbase20:42133] zookeeper.ZKUtil(398): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-31 05:55:39,122 WARN [M:0;jenkins-hbase20:42133] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-31 05:55:39,122 INFO [M:0;jenkins-hbase20:42133] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-31 05:55:39,122 INFO [M:0;jenkins-hbase20:42133] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-31 05:55:39,122 DEBUG [M:0;jenkins-hbase20:42133] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-31 05:55:39,122 INFO [M:0;jenkins-hbase20:42133] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-31 05:55:39,123 DEBUG [M:0;jenkins-hbase20:42133] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-31 05:55:39,123 DEBUG [M:0;jenkins-hbase20:42133] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-31 05:55:39,123 DEBUG [M:0;jenkins-hbase20:42133] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-31 05:55:39,123 INFO [M:0;jenkins-hbase20:42133] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.31 KB heapSize=599.12 KB 2023-10-31 05:55:39,131 INFO [M:0;jenkins-hbase20:42133] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.31 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/37d7db1bd79c4235a2c4b70136db980f 2023-10-31 05:55:39,133 INFO [M:0;jenkins-hbase20:42133] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37d7db1bd79c4235a2c4b70136db980f 2023-10-31 05:55:39,134 DEBUG [M:0;jenkins-hbase20:42133] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/37d7db1bd79c4235a2c4b70136db980f as hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/37d7db1bd79c4235a2c4b70136db980f 2023-10-31 05:55:39,137 INFO [M:0;jenkins-hbase20:42133] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37d7db1bd79c4235a2c4b70136db980f 2023-10-31 05:55:39,137 INFO [M:0;jenkins-hbase20:42133] regionserver.HStore(1080): Added hdfs://localhost:38365/user/jenkins/test-data/dce54a58-c35a-299b-d033-e25376e89e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/37d7db1bd79c4235a2c4b70136db980f, entries=123, sequenceid=1006, filesize=33.3 K 2023-10-31 05:55:39,137 INFO [M:0;jenkins-hbase20:42133] regionserver.HRegion(2948): Finished flush of dataSize ~513.31 KB/525628, heapSize ~599.10 KB/613480, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 14ms, sequenceid=1006, compaction requested=false 2023-10-31 05:55:39,138 INFO [M:0;jenkins-hbase20:42133] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-31 05:55:39,138 DEBUG [M:0;jenkins-hbase20:42133] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-31 05:55:39,140 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-31 05:55:39,140 INFO [M:0;jenkins-hbase20:42133] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-31 05:55:39,141 INFO [M:0;jenkins-hbase20:42133] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42133 2023-10-31 05:55:39,142 DEBUG [M:0;jenkins-hbase20:42133] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,42133,1698731564798 already deleted, retry=false 2023-10-31 05:55:39,218 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-31 05:55:39,219 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): regionserver:43723-0x101868d6ce30001, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-31 05:55:39,218 INFO [RS:0;jenkins-hbase20:43723] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,43723,1698731565849; zookeeper connection closed. 2023-10-31 05:55:39,219 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@47532683] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@47532683 2023-10-31 05:55:39,220 INFO [Listener at localhost/40291] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-10-31 05:55:39,319 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-31 05:55:39,319 INFO [M:0;jenkins-hbase20:42133] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,42133,1698731564798; zookeeper connection closed. 2023-10-31 05:55:39,319 DEBUG [Listener at localhost/40291-EventThread] zookeeper.ZKWatcher(600): master:42133-0x101868d6ce30000, quorum=127.0.0.1:64652, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-31 05:55:39,323 WARN [Listener at localhost/40291] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-31 05:55:39,330 INFO [Listener at localhost/40291] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-31 05:55:39,447 WARN [BP-1308998086-148.251.75.209-1698731561085 heartbeating to localhost/127.0.0.1:38365] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-31 05:55:39,447 WARN [BP-1308998086-148.251.75.209-1698731561085 heartbeating to localhost/127.0.0.1:38365] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1308998086-148.251.75.209-1698731561085 (Datanode Uuid 0cabfc00-225c-4275-b10c-db678f1f126c) service to localhost/127.0.0.1:38365 2023-10-31 05:55:39,450 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/cluster_8ab50123-55f1-194a-5eb5-80cabe53771a/dfs/data/data1/current/BP-1308998086-148.251.75.209-1698731561085] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-31 05:55:39,450 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/201ff15d-4468-d7cd-82a7-2d048fa06b74/cluster_8ab50123-55f1-194a-5eb5-80cabe53771a/dfs/data/data2/current/BP-1308998086-148.251.75.209-1698731561085] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-31 05:55:39,478 INFO [Listener at localhost/40291] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-31 05:55:39,608 INFO [Listener at localhost/40291] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-31 05:55:39,683 INFO [Listener at localhost/40291] hbase.HBaseTestingUtility(1293): Minicluster is down